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(54) Method and apparatus for converting color component type of picture signals, method and 
apparatus for converting compression format of picture signals and system for providing 
picture signals of a required compression format 



(57) In this picture signal converting apparatus, dig- 
ital picture signals compressed in a DVC format are de- 
coded to non-compressed picture signals of a 4:1:1 
color component type which are composed of color dif- 
ference signals and luminance signals. The color differ- 
ence signals of the 4:1 : 1 color component type arranged 
in a matrix are removed on every other row to halve the 
number of color difference signals in a y direction, and 
a color difference signal is added to a position between 
each pair of color difference signals adjacent to each 



other in an x direction to double the number of color dif- 
ference signals in the x direct ion.. Therefore, converted 
color difference signals of a 4:2:0 color component type 
are produced from the color difference signals. Values 
of the converted color difference signals are determined 
according to values of the color difference signals. 
Thereafter, the converted color difference signals and 
the luminance signals of the non-compressed picture 
signals are combined to produce converted digital pic- 
ture signals of the 4:2:0 color component type. 
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Description 

The present invention relates generally to a picture signal converting apparatus in which digital picture signals are 
converted, a picture signal converting method used in the picture signal converting apparatus and a picture providing 
s system for providing picture signals obtained by converting digital picture signals in the picture signal converting ap- 
paratus, and more particularly to digital picture converting method and apparatus for directly converting digital picture 
signals based on a color component type or a compression format into digital picture signals based on another color 
component type or another compression format. 

Recently, a picture apparatus for processing digital picture signals has been often used, and digital picture signals 
io of a color component type has been frequently used as the digital picture signals. In the digital picture signals of a color 
component type, a digital picture signal corresponding to one pixel is divided into a luminance signal Y and a first color 
difference signal Cr and a second color difference signal Cb, and there are many color component types respectively 
corresponding to a sampling frequency ratio of a group of two color difference signals Cr and Cb to a group of luminance 
signals. 

is a first color component type is a 4:4:4 color component type. As shown in Fig. 1 A, one color difference signal Cr 

of one pixel and one color difference signal Cb of one pixel respectively correspond to a luminance signal Y of the 
same pixel for each pixel. Therefore, one luminance signal Y and two color difference signals Cr and Cb exist for each 
pixel. In this case, as shown in Fig. 1 B, in cases where an X-Y co-ordinate system is considered for each type of signal 
Y, Cr and Cb, one luminance signal Y (x y) placed at co-ordinates (x.y) corresponds to a pixel placed at co-ordinates (x, 

20 y) of a frame, two color difference signals Cr (x y) and Cb (x y) placed at co-ordinates (x,y) respectively correspond to the 
luminance signal Y (x y) . In this case, an information volume of luminance signals Y for one frame is the same as that 
of color difference signals Cr for one frame and that of color difference signals Cb for one frame. Here, x=0,1 ,2,3-- and 
y=0,1 ,2,3- are satisfied. 

A second color component type is a 4:2:2 color component type. As shown in Fig. 2A, one color difference signal 
25 Cr of one pixel and one color difference signal Cb of one pixel respectively correspond to two luminance signals of two 
pixels arranged in series. Therefore, as shown in Fig. 2B, in cases where an X-Y co-ordinate system is considered for 
each type of signal Y, Cr and Cb, one luminance signal Y (x y) placed at co-ordinates (x,y) corresponds to a pixel placed 
at co-ordinates (x,y) of a frame, two color difference signals Cr (x y) and Cb (x y) respectively correspond to one luminance 
signal Y (2x y) and one luminance signal Y (2x+1 y) . In this case, an information volume of color difference signals Cr for 
30 one frame and an information volume of color difference signals Cb for one frame are respectively half that of luminance 
signals Y for one frame. 

A third color component type is a 4:2:0 color component type. As shown in Fig. 3A, a color difference signal Cr of 
one pixel and a color difference signal Cb of one pixel respectively correspond to four luminance signals of four pixels 
arranged in a matrix of two lines and two rows. Therefore, as shown in Fig. 3B, in cases where an X-Y co-ordinate 

35 system is considered for each type of signal Y, Cr and Cb, one luminance signal Y (x y) placed at co-ordinates (x,y) 
corresponds to a pixel placed at co-ordinates (x,y) of a frame, two color difference signals Cr (x y) and Cb (x y) respectively 
correspond to one luminance signal Y (2x- 2y)' one luminance signal Y (2x+1 ^ one luminance signal Y (2x2y+ i) and one 
luminance signal Y (2x+1 2y+D- ln tnis case > an information volume of color difference signals Cr for one frame and an 
information volume of color difference signals Cb for one frame are respectively a quarter of that of luminance signals 

40 Y for one frame. 

A fourth color component type is a 4:1:1 color component type. As shown in Fig. 4 A, a color difference signal Cr 
of one pixel and a color difference signal Cb ol one pixel respectively correspond to four luminance signals of four 
pixels arranged in series. Therefore, as shown in Fig. 4B, in cases where an X-Y co-ordinate system is considered for 
each type of signal Y, Cr and Cb, one luminance signal Y (x y) placed at co-ordinates (x,y) corresponds to a pixel placed 
45 at co-ordinates (x,y) of a frame, two color difference signals Cr (x y) and Cb (x y) respectively correspond to one luminance 
signal Y (4xy) , one luminance signal Y (4x+1 y)) one luminance signal Y (4x+2 y) and one luminance signal Y (4x+3 y) . In this 
case : an information volume of color difference signals Cr for one frame and an information volume of color difference 
signals Cb for one frame are respectively a quarter of that of luminance signals Y for one frame. 

so 2.1 . PREVIOUSLY PROPOSED ART: 

A digital picture signal has been recently used in various video apparatuses such as a camera with a video tape 
recorder for. public use or in the personal computers, so that a digital picture signal converting apparatus has been 
rapidly widespread. In general, the digital picture signal used in the personal computers and the video apparatuses for 
ss public use is compressed at a standardized compression format, and two types of compression formats are frequently 
used. 

A first type of compression format is based on image compression standards of moving picture experts group 1 
(MPEG1 ) or image compression standards of moving picture experts group 2 (MPEG2) The compression format based 
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on MPEG1 or MPEG2 is often used for the picture signal used in a computer In the compression formats based on 
MPEG1 and MPEG2, a time-redundancy between frames is reduced by performing a motion compensation, a space- 
redundancy in each frame is reduced by performing a discrete cosine transform, and a code volume is reduced by 
performing a variable length coding. MPEG1 is explained in a literature of ISO/IEC 11172-2 'Information Technology 

5 -Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1 .5 Mbits/s- Part 2: Video", 
and MPEG2 is explained in a literature of ISO/IEC 1 381 8-2 "Information Technology -Generic Coding of Moving Pictures 
and Associated Audio Information-Part 2: Video". Therefore, a detail description of MPEG1 and MPEG2 is omitted. 

Fig 5 is a block diagram of a conventional MPEG data producing apparatus in which MPEG data is produced 
according to the compression format based on MPEG1 or MPEG2. 

10 As shown in Fig. 5, when a user uses an analog video apparatus 101 with an analog signal output terminal such 

as a video lape player or a video camera on condition that the analog video apparatus 1 01 has no digital signal output 
terminal an analog picture signal output from the analog video apparatus 101 is converted into a non -compressed 
digital picture signal in an analog-to-digital converter 102. Also, when the user uses a digital video apparatus 1 03 with 
a digital signal output terminal, a non-compressed digital picture signal is directly output from the digital video apparatus 

is 103. Therealter the non-compressed digital picture signal is input to an MPEG encoder 104, and MPEG data are 
produced from the non-compressed digital picture signal in the MPEG encoder 104 according to the compression 
format based on MPEGl or MPEG2. 

In this case the non-compressed digital picture signal input to the MPEG encoder 104 is classified into the 4:2:2 
color component type or the 4 4.4 color component type, all MPEG data based on MPEG1 is classified into the 4:2:0 

20 color component type, and many MPEG data based on MPEG2 is classified into the 4:2:0 color component type. 

A second type of compression format is based on image compression standards of DV, DVC, DVCPRO or DVcam. 
The image compression standards are applied for a picture (or video) signal used in a digital video apparatus including 
a video apparatus for public use. Because signal data structures and compression formats based on DV, DVC, DVC- 
PRO and DVcam are similar to each other, DVC, DVCPRO and DVcam are treated as DV in this specification. DV is 

25 image compression standards enacted in 1 996 for a video cassette recorder and is based on "Specifications of.Con- 
sumer-Use Digital VCRs (HD Digital VCR Conference, 1996)". A video apparatus using a picture signal based on DV 
has been recently widespread rapidly. Also, a video camera for public use has been widespread rapidly as a video 
apparatus using a picture signal based on DV, so that people can easily produce a picture signal based on DV at a 
low cost. 

30 In the compression format based on DV, redundancy in each frame is reduced by performing a discrete cosine 

transform, and a code volume is reduced by performing a variable length coding. In addition, positions of data are 
changed in each frame in macroblock unit by performing a shuffling processing for a compressed signal based on DV. 

A picture signal input or output to/from a video apparatus using a picture signal based on DV is classified into the 
4:2:2 color component type or the 4:4:4 color component type, and the picture signal used in the video apparatus 

35 usually is classified into the 4: 1 : 1 color component type. 

As compared with MPEG data of an MPEG picture signal based on MPEG1 or MPEG2, when DV data of a DV 
picture signal based on DV is used, because the DV data are independently used for each frame, an editing operation 
of the DV data such as "cut & paste" can be easily performed for each frame. Also, because a code volume of the DV 
data for each frame is high and is almost six times as high as that of the MPEG data, a high quality image can be 

40 generally reproduced in case of the DV data. 

Also, because the DV data having merits of the high quality image and the easy edition can be input to a computer, 
when a user operates a computer to process a picture, the user desires to use DV data of the picture in an input 
operation, an editing operation and a data storing operation for the purpose of easily processing the DV data and 
reproducing the picture at high quality. Also, the user desires to use MPEG data obtained from the DV data when the 

45 user transmits the picture to another computer through an internet or the like. 

2.2. PROBLEMS TO BE SOLVED BY THE INVENTION: 

To produce the MPEG data from the DV data, it is required that the user uses a video apparatus using the DV 
50 picture signal as the digital video apparatus 1 03 and connects the video apparatus with the MPEG encoder 1 04. There- 
fore, two apparatuses such as the video apparatus using the DV picture signal and the MPEG encoder 104 are nec- 
essarily required, so that the user cannot process a picture at a low cost. 

To process the picture at a low cost, there is an idea that the DV data of the picture input to a computer is directly 
converted into the MPEG data according to a software program without using any MPEG encoder. However, in cases 
55 where the DV data is directly converted into the MPEG data according to a software program, there are following 
problems. That is, there is no method for directly converting a 4:1:1 color component type digital picture signal used 
in a digital video apparatus, in which the DV data is processed, into a 4:2:0 color component type digital picture signal 
used for the MPEG data (first problem). Also, in cases where the DVdata are decoded and the MPEG data are encoded, 
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because a processing volume of the decoding and encoding operation is large, it takes a lot of time to perform the 

decoding and encoding operation in a general computer (second problem). 

A first aim of the present invention is to provide, with due consideration to the drawbacks of such a conventional 

picture signal converting apparatus and a conventional picture signal converting method, a picture signal converting 
s apparatus and a picture signal converting method in which the direct conversion of a plurality of digital picture signals 

of a first color component type into a plurality of digital picture signals of a second color component type is easily and 

rapidly performed at a low cost. 

A second aim of the present invention is to provide a picture signal converting apparatus and a picture signal 

converting method in which the direct conversion of a plurality of digital picture signals compressed in a first compres- 
10 sion format into a plurality of digital picture signals compressed in a second compression format is easily and rapidly 

performed at a low cost. 

A third aim of the present invention is to provide a picture providing system for providing a plurality of digital picture 
signals compressed according to a compression format requested by a user 

The present invention provides a picture signal converting apparatus comprising: 

15 

receiving means for receiving a digital picture signal of a 4:1 : 1 color component type for each of pixels of a frame, 
the digital picture signals being arranged in a matrix of rows and columns; 

color difference signal converting means for directly converting color difference signals of the digital picture signals 

received by the receiving means into converted color difference signals of converted digital picture signals of a 4: 
20 2:0 color component type by removing color difference signals on every other row from the color difference signals 

of the digital picture signals to halve the number of color difference signals in a y direction, adding a color difference 

signal to a position between each pair of color difference signals adjacent to each other in an x direction to double 
. the number of color difference signals in the x direction and setting the color difference signals, of which the number 

is halved in the y direction and is doubled in the x direction, as the converted color difference signals of the 4:2:0 
25 color component type, and setting values of the converted color difference signals of the 4:2:0 color component 

type according to values of the color difference signals of the digital picture signals received by the receiving 

means; and 

outputting means for combining luminance signals of the digital picture signals received by the receiving means 
and the converted color difference signals of the converted digital picture signals of the 4:2:0 color component 
30 type obtained by the color difference signal converting means for each pixel of the frame to produce digital picture 

signals of the 4:2:0 color component type and outputting the digital picture signals of the 4:2:0 color component type. 

In the above configuration, a color difference signal of the 4:1:1 color component type corresponds to four lumi- 
nance signals of four pixels placed at co-ordinates (x,y), (x+1,y), (x,y+1) and (x+1,y+1), and a color difference signal 

35 of the 4:2:0 color component type corresponds to four luminance signals of four pixels placed at coordinates (x,y), 
(x+1 ,y), (x+2,y) and (x+3,y). Therefore, in cases where the number of color difference signals in the y direction is halved 
and the number of color difference signals in the x direction is doubled, the color difference signals of the 4:1:1 color 
component type are converted into converted color difference signals of the 4:2:0 color component type. In this case, 
values of the converted color difference signals are determined according to values of the color difference signals. 

40 Also, because luminance signals of digital picture signals of the 4:1 : 1 color component type are the same as those 

of the digital picture signals of the 4:2:0 color component type, digital picture signals of the 4:2:0 color component type 
are produced by combining luminance signals of the digital picture signals of the 4:1:1 color component type and the 
converted color difference signals of the 4:2:0 color component type. 

Accordingly, because the color difference signals of the 4:1:1 color component type can be easily converted into 

45 the convened color difference signals of the 4:2:0 color component type, the direct conversion of the digital picture 
signals of the 4: 1 : 1 color component type into the digital picture signals of the 4:2:0 color component type can be easily 
and rapidly performed. 

It is preferred that the color difference signal converting means comprise 

50 y-directional signal halving means for removing color difference signals on every other row from the color difference 

signals of the digital picture signals to halve the number of color difference signals in the y direction; and 
x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals which are obtained by the y-directional signal halving moans and are adjacent to each other in 
an X direction, setting a value of one added color difference signal to a value of one color difference signal adjacent 

55 to the added color difference signal in the x direction for each added color difference signal to double the number 

of color difference signals obtained by the y-directional signal halving means in the x direction and outputting the 
color difference signals as the converted color difference signals of the 4:2:0 color component type. 
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In the above configuration, when a color difference signal is added to a position between each pair of color differ- 
ence signals adjacent to each other in an X direction to double the number of color difference signals in the x direction, 
a value of each added color difference signal is set to a value of one color difference signal adjacent to the added color 
difference signal in the x direction, 
s Accordingly, because any arithmetic calculation is not required to convert the color difference signals of the 4:1 :1 

color component type into the color difference signals of the 4:2:0 color component type, the color signal converting 
operation can be easily performed. 

The above features of the present invention are also obtained by the provision of a picture signal converting method, 
comprising the steps of: 

10 

receiving a digital picture signal of a 4:1 :1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,1 : 2,3,«, and 

y=0, 1,2,3,-) from the digital picture signals; 

halving the number of color difference signals in a y direction by removing color difference signals placed at co- 
is ordinates (x,2y) of even-numbered y values or coordinates (x,2y+1 ) of odd-numbered y values; 

doubling the number of color difference signals in an x direction by adding a color difference signal to a position 
between each pair of color difference signals adjacent to each other in the X direction; 

setting a value of one added color difference signal to a value of one color difference signal adjacent to the added 
color difference signal in the x direction for each added color difference signal to produce converted color difference 
20 signals of a 4:2:0 color component type from the color difference signals in which the number of converted color 

difference signals is halved in the y direction as compared with the number of cobr difference signals and the 
number of converted color difference signal is doubled in the x direction as compared with the number of. color 
difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
25 digital picture signals of the 4:2:0 color component type; and 

outputting the digital picture signals of the 4:2:0 color component type. 

Also, it is preferred that the color difference signal converting means comprise 

30 signal value setting means for setting values of two color difference signals of co-ordinates (x : 2y) and (x,2y+1) (or 

(x,2y+l ) and (x,2y+2)) adjacent to each other in a y direction to an average of values of the color difference signals 
of the co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1) and (x : 2y+2)) for each pair of color difference signals of co- 
ordinates (x,2y) and (x,2y+1) (or (x,2y+1) and (x,2y+2)); 

y-directional signal halving means lor removing color difference signals on every other row from the color difference 
35 signals, of which the values are set by the signal value setting means, to halve the number of color difference 

signals in the y direction; and 

x-directionai signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals which are obtained by the y-directional signal halving means and are adjacent to each other in 
an X direction, setting a value of one added color difference signal to a value of a color difference signal adjacent 
40 to the added color difference signal in the x direction for each added color difference signal to double the number 

of color difference signals obtained by the y-directional signal halving means in the x direction and outputting the 
color difference signals as the converted color difference signals of the 4:2:0 color component type. 

In the above configuration, an average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1 ) 
45 (or (x,2y+l) and (x,2y+2)) is calculated, and the average is set as values of the color difference signals. Thereafter, 
the number of color difference signals in the y direction is halved, and the number of color difference signals in the x 
direction is doubled. 

Accordingly, because values of all color difference signals are used to set values of Ihe converted color difference 
signals, cobr information of the digital picture signals of the 4:1:1 color component type can be faithfully maintained 
50 in the digital picture signals of the 4:2:0 color component type. Therefore, an original picture indicated by the digital 
picture signals of the 4:1:1 color component type can be faithfully reproduced at a high quality by producing a repro- 
duced picture from the digital picture signals of the 4:2:0 color component type. 

Also, because an average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1 ) (or (x,2y+1 ) 
and (x,2y+2)) is set as values of the color difference signals, even though a noise is undesirably added to a particular 
55 color difference signal, an adverse influence of the noise on the converted color difference signals can be reduced to 
half. 

Also, because the calculation of the arithmetic average is only required in the signal value setting means, the 
arithmetic calculation is easy. 
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The above features of the present invention are also obtained by the provision of a picture signal converting method, 
comprising the steps of: 

receiving a digital picture signal of a 4:1:1 color component type for each of pixels of a frame; 
s extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,1 : 2,3,~, and 

y=0.1 ,2,3.--) from the digital picture signals; 

calculating an average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1) 
and (x.2y+2)) adjacent to each other in a y direction for each pair of color difference signals; 
setting each average as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1 ) 
10 and (x.2y+2)): 

halving the number of color difference signals in the y direction by removing color difference signals placed at co- 
ordinates (x.2y) of even-numbered y values or co-ordinates (x,2y+1 ) of odd-numbered y values: 
doubling the number of color difference signals in an x direction by adding a color difference signal to a position 
between each pair of color difference signals adjacent to each other in the X direction; 

is setting a value of one added color difference signal to a value of one color difference signal adjacent to the added 

color difference signal in the x direction for each added color difference signal to produce converted color difference 
signals of a 4:2:0 color component type from the color difference signals in which the number of converted color 
difference signals ts halved in the y direction as compared with the number of color difference signals and the 
number of converted color difference signal is doubled in the x direction as compared with the number of color 

20 difference signals. 

combining the converted coloi difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4.2:0 color component type; and 
outputting the digital picture signals of the 4:2:0 color component type. 

25 Also, it is preferred that the color difference signal converting means comprise 

signal value setting means for setting values of two color difference signals of co-ordinates (x : 2y) and (x,2y+1 ) (or 
(x,2y+1) and (x,2y+2)) adjacent to each other in the y direction to an average of values of the color difference 
signals of the co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1) and (x,2y+2)) for each pair of color difference signals 
30 of co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1 ) and (x,2y+2)); 

y-directional signal halving means for removing color difference signals on every other row from the color difference 
signals, of which the values are set by the signal value setting means, to halve the number of color difference 
signals in the y direction: and 

x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
35 difference signals which are obtained by the y-directional signal halving means and are adjacent to each other in 

an X direction, setting a value of one added color difference signal to an interpolated value of the values of the 
color difference signals placed on both sides of the added color difference signal in the x direction for each added 
color difference signal to double the number of color difference signals obtained by the y-directional signal halving 
means in the x direction and outputting the color difference signals as the converted color difference signals of the 
40 4:2:0 color component type. 

In the above configuration, an average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1 ) 
(or (x,2y+1) and (x,2y+2)) is set as values of the color difference signals by the signal value setting means, and the 
number of color difference signals in the y direction is halved by the y-directional signal halving means. Thereafter, in 

4 $ the x-directional signal doubling means, a color difference signal is added to a position between each pair of color 
difference signals adjacent to each other in an X direction, and a value of each added color difference signal is set to 
an interpolated value of the values of the color difference signals placed on both sides of the added color difference 
signal in the x direction to double the number of color difference signals in the x direction. 

Accordingly, even though values of particular converted color difference signals placed on both sides of one added 

50 color difference signal in the x direction are considerably different from each other, because an interpolated value of 
the values of the particular converted color difference signals is set as a value of a converted color difference signal 
placed between the particular converted color difference signals, the change of the values of the three converted color 
difference signals is made smooth. Therefore, when a discrete cosine transform (DCT) is performed for the converted 
color difference signals of the 4:2:0 color component type, because color information of the converted color difference 

55 signals is concentrated in lower frequency portions, a compression efficiency can be improved. 

The above features of the present invention are also obtained by the provision of a picture signal converting method, 
comprising the steps of: 
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receiving a digital picture signal of a 4:1 :1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x^O.1,2,3,— , and 

y=0, 1,2,3,--) from the digital picture signals; 

calculating an average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1 ) 
5 and (x,2y+2)) adjacent to each other in a y direction for each pair of color difference signals; 

setting each average as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1 ) 
and (x,2y+2)); 

halving the number of color difference signals in the y direction by removing color difference signals placed at co- 
ordinates (x,2y) of even-numbered y values or coordinates (x,2y+1 ) of odd-numbered y values; 
'0 adding a color difference signal to a position between each pair of color difference signals adjacent to each other 

in an X direction to double the number of color difference signals in the x direction; 

setting a value of one added color difference signal to an interpolated value of the values of the color difference 
signals placed on both sides of the added color difference signal in the x direction for each added color difference 
signal to produce converted color difference signals of a 4:2:0 color component type from the color difference 

'5 signals in which the number of converted color difference signals is halved in the y direction as compared with the 

number of color difference signals and the number of converted color difference signal is doubled in the x direction 
as compared with the number of color difference signals; ^ 
combining the converted color difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4:2:0 color component type; and 

20 outpulting the digital picture signals of Ihe 4:2:0 color component type. 

Also, it is preferred that the color difference signal converting means comprise 

average value calculating means for calculating a first average of values of two color difference signals placed at 
2S co-ordinates (x,2y) and (x,2y+1 ) (or (x,2y+1 ) and (x,2y+2)) adjacent to each other in the y direction and a second 

average of values of two color difference signals placed at co-ordinates (x+1,2y) and (x+1,2y+1) (or (x+1,2y+1) 
and (x+1,2y+2)) adjacent to each other in the y direction for each group of color difference signals of the co- 
ordinates (x,2y), (x : 2y+1), (x+1,2y) and (x+1,2y+1) (or (x,2y+1), (x,2y+2), (x+1,2y+1 ) and (x+1,2y+2)); 
interpolated value calculating means for calculating a first interpolated value obtained by weighting the first and 
30 second averages calculated by the average value calculating means at a first weighting ratio and a second inter- 

polated value obtained by weighting the first and second averages at a second weighting ratio for each pair of first 
and second averages; 

signal value setting means for setting the first interpolated value calculated by the interpolated value calculating 
means as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1 ) (or (x,2y+1 ) and (x,2y+2)); 
35 y-directional signal halving means for removing color difference signals on every other row from the color difference 

signals, of which the values are set by the signal value setting means, to halve the number of color difference 
signals in the y direction; and 

x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals adjacent to each other in an X direction, setting a value of one added color difference signal to 
40 the second interpolated value calculated by the interpolated value calculating means for each added color differ- 

ence signal to double the number of color difference signals obtained by the y-directional signal halving means in 
the x direction and outputting the color difference signals as the converted color difference signals of the 4:2:0 
color component type. 

4$ In the above configuration, a first interpolated value calculated from values of four color difference signals of co- 

ordinates (x t 2y), (x,2y+1 ), (x+1 ,2y) and (x+1 ,2y+1 ) (or (x,2y+1 ), (x,2y+2), (x+1 ,2y+1 ) and (x+1 ,2y+2)) is set as values 
of the color difference signals of the co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1) and (x t 2y+2)) by the signal value 
setting means, and the number of color difference signals in the y direction is halved by the y-directional signal halving 
means. Thereafter, in the x-directional signal doubling means, a color difference signal is added to a position between 

50 each pair of color difference signals adjacent to each other in an X direction, and a value of each added color difference 
signal is set to a second interpolated value calculated from values of four color difference signals of co-ordinates (x, 
2y), (x,2y+l), (x+1,2y)and (x+1 ,2y+1 ) (or (x,2y+1), (x,2y-»-2), (x+1,2y+1)and (x+1 ,2y+2)) to double the number of color 
difference signals in the x direction. 

Accordingly, even though values of color difference signals are considerably different from each other, because 

55 values of all converted color difference signals are determined according to the linear interpolation, the change of the 
values of the converted color difference signals can be made smooth. Therefore, when a discrete cosine transform 
(DCT) is performed for the converted color difference signals of the 4:2:0 color component type, because color infor- . 
mation of the converted color difference signals is concentrated in lower frequency portions, a compression efficiency 
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can be improved. 

The above features of the present invention are also obtained by the provision of a picture signal converting method, 
comprising the steps of: 

receiving a digital picture signal of a 4:1 :1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,1 =2,3,--, and 

y=0,l,2,3,--) from the digital picture signals; 

calculating a first average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1 ) (or (x,2y+1 ) 
and (x,2y+2)) adjacent to each other in a y direction and a second average of values of two color difference signals 
of co-ordinates (x+1 ,2y) and (x+1 ,2y+1 ) (or (x+1 ,2y+1 ) and (x+1 ,2y+2)) adjacent to each other in the y direction 
for each group of color difference signals of the co-ordinates (x : 2y), (x,2y+1), (x+1,2y)and (x+1,2y+1) (or(x,2y+1), 
(x,2y+2), (x+1,2y+1) and (x+1,2y+2)); 

calculating a first interpolated value obtained by weighting the first and second averages at a first weighting ratio 
and a second interpolated value obtained by weighting the first and second averages at a second weighting ratio 
for each pair of first and second averages; 

setting the first interpolated value as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1) 
(or (x,2y+1 ) and (x,2y+2)); 

halving the number of color difference signals in the y direction by removing color difference signals placed at co- 
ordinates (x,2y) of even-numbered y values or co-ordinates (x,2y+1) of odd-numbered y values; 
adding a color difference signal to a position between each pair of color difference signals adjacent to each other 
in an X direction to double the number of color difference signals in the x direction; 

setting a value of one added color difference signal to the second interpolated value for each added color difference 
signal to produce converted color difference signals of a 4:2:0 color component type from the color difference 
signals in which the number of converted color difference signals is halved in the y direction as compared with the 
number of color difference signals and the number of converted color difference signal is doubled in the x direction 
as compared with the number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4:2:0 color component type; and 
outputting the digital picture signals of the 4:2:0 color component type. 

Also, it is preferred that the color difference signal converting means comprise 

average value calculating means for calculating an average of values of two color difference signals placed at co- 
ordinates (x,2y) and (x,2y+1) adjacent to each other in the y direction for each pair of color difference signals; 
weighting factor calculating means for obtaining luminance signals of the digital picture signals corresponding to 
the color difference signals of co-ordinates (x,2y) and (x+1 ,2y) as first referential luminance signals, calculating a 
first weighting factor and a second weighting factor from values of the first referential luminance signals, obtaining 
luminance signals of the digital picture signals corresponding to the color difference signals of co-ordinates (x, 
2y+l ) and (x+1 ,2y+1 ) as second referential luminance signals and calculating a third weighting factor and a fourth 
weighting factor from values of the second referential luminance signals; 

interpolated value calculating means for calculating a first multiplied value by multiplying the value of the color 
difference signal of the co-ordinates (x,2y) by the first weighting factor obtained by the weighting factor calculating 
means, calculating a second multiplied value by multiplying the value of the color difference signal of the co- 
ordinates (x+1 ,2y) by the second weighting factor obtained by the weighting factor calculating means, calculating 
a third multiplied value by multiplying the value of the color difference signal of the co-ordinates (x,2y+1) by the 
third weighting factor obtained by the weighting factor calculating means, calculating a fourth multiplied value by 
multiplying the value of the color difference signal of the co-ordinates (x+1,2y+l) by the fourth weighting factor 
obtained by the weighting factor calculating means and calculating an interpolated value from the first, second, 
third and fourth multiplied values; 

signal value setting means for setting each average calculated by the average value calculating means as values 
of the color difference signals of the co-ordinates (x,2y) and (x,2y+1); 

y-directional signal halving means 1or removing color difference signals on every other row from the color difference 
signals, of which the values are set by the signal value setting means, to halve the number of color difference 
signals in the y direction; and 

x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals adjacent to each other in an X direction, setting a value of one added color difference signal to 
the interpolated value calculated by the interpolated value calculating means for each added color difference signal, 
to double the number of color difference signals obtained by the y-directional signal halving means in the x direction 
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and outputting the color difference signals as the converted color difference signals of the 4:2:0 color component 
type. 

In the above configuration, the interpolated value set for each of converted color difference signals, which are 
5 arranged on every other column in the converted color difference signals of the 4:2:0 color component type output from 
the color difference signal converting means, is calculated while referring values of luminance signals corresponding 
to the converted color difference signal. 

Accordingly, because the luminance signals are referred when the digital color signals of the 4:1 : 1 color component 
type are directly converted into the digital color signals of the 4:2:0 color component type, the correlation between color 
w information and luminance information generally existing in a natural picture as a specific feature can be included in 
the converted color difference signals, and an image of the natural picture can be reproduced at high definition. 

The above features of the present invention are also obtained by the provision of a picture signal converting method, 
comprising the steps of: 

is receiving a digital picture signal of a 4:1 :1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,1 : 2,3,--, and 
y=0, 1,2,3,--) from the digital picture signals; 

calculating an average of values of two color difference signals of co-ordinates (x : 2y) and (x,2y+1) adjacent to 
each other in the y direction for each pair of color difference signals; 
20 extracting luminance signals placed at co-ordinates (x,y) of an X-Y luminance co-ordinate system from the digital 

picture signals as first referential luminance signals on condition that the first referential luminance signals corre- 
spond to the color difference signals of co-ordinates (x,2y) and (x+1 ,2y); 

calculating a first weighting factor and a second weighting factor from values of the first referential luminance 
signals; 

25 extracting other luminance signals of the X-Y luminance co-ordinate system from the digital picture signals as 

second referential luminance signals on condition that the second referential luminance signals correspond to the 
color difference signals of co-ordinates (x,2y+1) and (x+1 ,2y+1); 

calculating a third weighting factor and a fourth weighting factor from values of the second referential luminance 
signals; 

30 calculating a first multiplied value by multiplying the value of the color difference signal of the co-ordinates (x,2y) 

by the first weighting factor, calculating a second multiplied value by multiplying the value of the color difference 
signal of the co-ordinates (x+1 ,2y) by the second weighting factor, calculating a third multiplied value by multiplying 
the value of the color difference signal of the co-ordinates (x,2y+1 ) by the third weighting factor, calculating a fourth 
multiplied value by multiplying the value of the color difference signal of the co-ordinates (x+1,2y+1) by the fourth 

35 weighting factor and calculating an interpolated value from the first, second, third and fourth multiplied values; 

setting each average as values of the color difference signals of the coordinates (x,2y) and (x,2y+1); 
halving the number of color difference signals in the y direction by removing color difference signals placed at co- 
ordinates (x,2y) of even-numbered y values or co-ordinates (x,2y+1 ) of odd-numbered y values; 
adding a color difference signal to a position between each pair of color difference signals adjacent to each other 

40 in an X direction to double the number of color difference signals in the x direction; 

setting a value of one added color difference signal to the interpolated value for each added color difference signal 
to produce converted color difference signals of a 4:2:0 color component type from the color difference signals in 
which the number of converted color difference signals is halved in the y direction as compared with the number 
of color difference signals and the number of converted color difference signal is doubled in the x direction as 

45 compared with the number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4:2:0 color component type: and 
outputting the digital picture signals of the 4:2:0 color component type. 

50 Also, it is preferred that the color difference signal converting means comprise 

weighting factor calculating means for obtaining luminance signals corresponding to the color difference signals 
of co-ordinates (x,2y) and (x+1,2y) as first referential luminance signals , calculating a first weighting factor, a 
second'weighting factor, a third weighting factor and a fourth weighting factor from values of the first referential 
55 luminance signals, obtaining luminance signals corresponding to the color difference signals of co-ordinates (x, 

2y+1 ) and (x+1 ,2y+1 ) as second referential luminance signals and calculating a fifth weighting factor and a sixth 
weighting factor, a seventh weighting factor and an eighth weighting factor from values of the second referential 
luminance signals; 
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interpolated value calculating means for calculating a first multiplied value by multiplying the value of the color 
• difference signal of the co-ordinates (x,2y) by the first weighting factor obtained by the weighting factor calculating 
means, calculating a second multiplied value by multiplying the value of the color difference signal of the co- 
ordinates (x+1 ,2y) by the second weighting factor obtained by the weighting factor calculating means, calculating 

$ a third multiplied value by multiplying the value of the color difference signal of the co-ordinates (x,2y+1) by the 

fifth weighting factor obtained by the weighting factor calculating means, calculating a fourth multiplied value by 
multiplying the value of the color difference signal of the co-ordinates (x+1,2y+1) by the sixth weighting factor 
obtained by the weighting factor calculating means, calculating a first interpolated value from the first, second, 
third and fourth multiplied values, calculating a fifth multiplied value by multiplying the value of the color difference 

jo signal of the co-ordinates (x,2y) by the third weighting factor obtained by the weighting factor calculating means, 

calculating a sixth multiplied value by multiplying the value of the color difference signal of the co-ordinates (x+1 ,2y) 
by the fourth weighting factor obtained by the weighting factor calculating means, calculating a seventh multiplied 
value by multiplying the value of the color difference signal of the co-ordinates (x,2y+1) by the seventh weighting 
factor obtained by the weighting factor calculating means, calculating an eighth multiplied value by multiplying the 

'5 value of the color difference signal of the co-ordinates (x+1 ,2y+1) by the eighth weighting factor obtained by the 

weighting factor calculating means, calculating a second interpolated value from the fifth, sixth, seventh and eighth 
multiplied values; 

signal value setting means for setting the first interpolated value calculated by the interpolated value calculating 
means as values of the color difference signals of the co-ordinates (x,2y) and (x : 2y+1 ); 
20 y-directionat signal halving means for removing color difference signals on every other row from the color difference 

signals, of which the values are set by the signal value setting means, to halve the number of color difference 
signals in the y direction; and 

x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals which are obtained by the y-directional signal halving means and are adjacent to each other in 
25 an X direction, setting a value of one added color difference signal to the second interpolated value calculated by 

the interpolated value calculating means for each added color difference signal to double the number color differ- 
ence signals obtained by the y-directional signal halving means in the x direction and outputting the color difference 
signals as the converted color difference signals of the 4:2:0 color component type. 

30 in the above configuration, the interpolated value set for each of the converted color difference signals of the 4:2: 

0 color component type output from the color difference signal converting means is calculated while referring values 
of luminance signals corresponding to the converted color difference signal. 

Accordingly, because each converted color difference signal is determined according to the interpolation based 
on four color difference signals, even though values of the color difference signals are considerably different from each 

35 other, the change of the values of the converted color difference signals can be made smooth. Therefore, when a 
discrete cosine transform (DCT) is performed for the converted color difference signals of the 4:2:0 color component 
type, because color information of the converted color difference signals is concentrated in lower frequency portions, 
a compression efficiency can be improved. 

Also, because the value of each converted color difference signal is determined by referring the luminance signals 

40 corresponding to the converted color difference signal, the correlation between color information and luminance infor- 
mation generally existing in a natural picture as a specific feature can be included in the converted color difference 
signals, and an image of the natural picture can be faithfully reproduced at high definition. 

The above features of the present invention are also obtained by the provision of a picture signal converting method, 
comprising the steps of: 

45 

receiving a digital picture signal of a 4:1 :1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,1 : 2,3,--, and 

y=0, 1,2,3,—) from the digital picture signals; 

extracting luminance signals placed at co-ordinates (x,y) of an X-Y luminance co-ordinate system from the digital 
so picture signals as first referential luminance signals on condition that the first referential luminance signals corre- 

spond to the color difference signals of co-ordinates (x,2y) and (x+1 ,2y); 

calculating a first weighting factor, a second weighting factor, a third weighting factor and a fourth weighting factor 
from values of the first referential luminance signals; 

extracting other luminance signals from the digital picture signals as second referential luminance signals on con- 
55 dition that the second referential luminance signals correspond to the color difference signals of co-ordinates (x, 

2y+1) and (x+1,2y+1); 

calculating a fifth weighting factor and a sixth weighting factor, a seventh weighting factor and an eighth weighting- 
factor from values of the second referential luminance signals; 
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calculating a first multiplied value by multiplying the value of the color difference signal of the coordinates (x,2y) 
by the first weighting factor; 

calculating a second multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x+1 ,2y) by the second weighting factor; 
5 calculating a third multiplied value by multiplying the value of the color difference signal of the coordinates (x, 

2y+1) by the fifth weighting factor; 

calculating a fourth multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x+1,2y+1) by the sixth weighting factor; 

calculating a first interpolated value from the first, second, third and fourth multiplied values; 
10 calculating a fifth multiplied value by multiplying the value of the color difference signal of the co-ordinates (x 3 2y) 

by the third weighting factor; 

calculating a sixth multiplied value by multiplying the value of the color difference signal of the coordinates (x+1 ,2y) 
by the fourth weighting factor; 

calculating a seventh multiplied value by multiplying the value of the cobr difference signal of the co-ordinates (x, 
is 2y+1 ) by the seventh weighting factor; 

calculating an eighth multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x+l ,2y+i ) by the eighth weighting factor; 

calculating a second interpolated value from the fifth, sixth, seventh and eighth multiplied values; 
setting the first interpolated value as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1 ); 
20 halving the number of color difference signals in the y direction by removing color difference signals placed at co- 

ordinates (x,2y) of even-numbered y values or co-ordinates (x,2y+1 ) of odd-numbered y values; 
adding a color difference signal to a position between each pair of color difference signals adjacent to each other 
in an X direction to double the number of color difference signals in the x direction; 

setting a value of one added color difference signal to the second interpolated value for each added color difference 
25 signal to produce converted color difference signals of a 4:2:0 color component type from the color difference 

signals in which the number of converted color difference signals is halved in the y direction as compared with the 
number of color difference signals and the number of converted color difference signal is doubled in the x direction 
as compared with the number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
30 digital picture signals of the 4:2:0 color component type; and 

outputting the digital picture signals of the 4:2:0 color component type. 

The second object is achieved by the provision of a picture signal converting apparatus comprising: 

receiving means for receiving a digital picture signal compressed in a first format for each of pixels of a frame; 
picture decoding means for decoding the digital picture signals received by the receiving means to produce a 
plurality of non -compressed picture signals of a 4:1 :1 color component type, the non-compressed picture signals 
being arranged in a matrix of rows and columns; 

component signal converting means for directly converting color difference signals of the non-compressed picture 
signals obtained by the picture decoding means into a plurality of converted color difference signals of a 4:2:0 
color component type by removing color difference signals on every other row from the color difference signals of 
the non-compressed picture signals to halve the number of color difference signals in a y direction and adding a 
color difference signal to a position between each pair of color difference signals adjacent to each other in an x 
direction to double the number of color difference signals in the x direction, setting values of the converted color 
difference signals of the 4:2:0 color component type according to values of the color difference signals of the non- 
compressed picture signals obtained by the picture decoding means and combining luminance signals of the non- 
compressed picture signals obtained by the picture decoding means and the converted color difference signals of 
the 4:2:0 color component type obtained by the color difference signal converting means for each pixel of the frame 
to produce non-compressed picture signals of the 4:2:0 color component type; 

picture coding means for coding the non-compressed picture signals of the 4:2:0 color component type obtained 
by the component signal converting means to produce a plurality of digital picture signals compressed in a second 
format different from the first format; and 

output means for outputting the digital picture signals compressed in the second format obtained by the picture 
coding means. 

In the above configuration, a plurality of digital picture signals compressed in a first format is decoded to a plurality 
on-compressed picture signals of a 4:1 :1 color component type, the non-compressed picture signals of the 4:1:1. 
>r component type are directly converted into a plurality of converted cobr difference signals of a 4:2:0 color com- 
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ponent type. In this conversion, color difference signals are removed on every other row from the color difference 
signals of the 4:1:1 color component type and color difference signals are added on every other column to remaining 
color difference signals. Therefore, a plurality of converted color difference signals of the 4:2:0 color component type, 
in which the number of signals in the y direction is half that of color difference signals of the 4:1:1 color component 

5 type and the number of converted color difference signals in the x direction is double that of color difference signals 
of the 4:1:1 color component type, are produced. Values of the converted color difference signals are determined 
according to values of the color difference signals of the 4:1:1 color component type. Thereafter, luminance signals of 
the non-compressed picture signals and the converted color difference signals of the 4:2:0 color component type are 
combined to produce non-compressed picture signals of the 4:2:0 color component type. Thereafter, the non-com- 

10 pressed picture signals of the 4:2:0 color component type are coded to a plurality of digital picture signals compressed 
in a second format. 

Accordingly, in cases where a user uses a plurality of digital compressed picture signals compressed in the first 
format in his computer C1 and the transmission of signals compressed in the second format from the computer to 
another computer C2 through a network is more advantageous than that of signals compressed in the first format, the 
is digital compressed picture signals compressed in the first format can be easily converted into a plurality of digital 
compressed picture signals compressed in the second format, and the digital compressed picture signals compressed 
in the second format can be rapidly transmitted to the computer C2 through a network. 

The above features ot the present invention are also obtained by the provision of a picture signal converting method, 
comprising the steps of: 

20 

receiving a digital picture signal compressed in a DVC format for each of pixels of a frame, the digital picture signals 
compressed in the DVC format being obtained by performing a discrete cosine transform (DCT) processing for 
each block of non-compressed picture signals of a 4: 1 : 1 color component type to obtain a block of DCT coefficients 
from each block of non-compressed picture signals, quantizing each block of DCT coefficients to obtain a block 
25 of quantized values from each block of DCT coefficients, coding each block of quantized values to obtain a block 

of variable-length codes from each block of quantized values and recording each block of variable-length codes 
as the digital picture signals compressed in the DVC format; 

decoding the digital picture signals to produce a plurality of non-compressed picture signals of a 4:1 :1 color com- 
ponent type, the non-compressed picture signals being arranged in a matrix of rows and columns; 
30 removing color difference signals on every other row from the color difference signals of the non-compressed 

picture signals to halve the number of color difference signals in a y direction; 

adding a color difference signal to a position between each pair of color difference signals adjacent to each other 
in an x direction to double the number of color difference signals in the x direction; 

setting values of the color difference signals according to values of the non-compressed picture signals of the 4: 
35 1;1 color component type to directly convert the color difference signals of the 4:1:1 color component type into 

converted color difference signals of a 4:2:0 color component type; 

combining luminance signals of the non-compressed picture signals of the 4:1:1 color component type and the 
converted color difference signals of the 4:2:0 cobr component type for each pixel of the frame to produce non- 
compressed picture signals of the 4:2:0 color component type; 
40 coding the non-compressed picture signals of the 4:2:0 color component type to produce a plurality of digital picture 

signals compressed in a moving picture experts group (MPEG) format in which a time-redundancy between frames 
is reduced by performing a motion compensation, a space-redundancy in each frame is reduced by performing a 
discrete cosine transform and a code volume is reduced by performing a variable length coding; and 
outputting the digital picture signals compressed in the MPEG format. 

45 

It is preferred that the first format be the DVC format, the second format be the MPEG format, the picture decoding 
means comprise 



preparing means for deshuffling the digital picture signals to rearrange the digital picture signals; 
so variable-length decoding means for performing a variable-length decoding for the digital picture signals deshuffled 

by the preparing means to produce a plurality of quantized values; 

inverted quantization means for performing an inverted quantization for the quantized values produced by the 
variable-length decoding means to produce a plurality of blocks of discrete cosine transform (DCT) coefficients of 
the non-compressed picture signals of the 4:1 :1 color component type; and 
ss inverted DCT processing means for performing an inverted DCT processing for each block of DCT coefficients 

produced by the inverted quantization means to produce a plurality of blocks of non-compressed picture signals 
of the 4: 1 :1 color component type, and the picture coding means comprise 

an input buffer for storing the non-compressed picture signals of the 4:2:0 color component type produced by the 
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component signal converting means as picture signals of a current frame frame by frame, the non-compressed 
picture signals being classified into a plurality of blocks of non -compressed picture signals respectively correspond- 
ing to a block of the current frame; 

DCT compressing means for performing a discrete cosine transform (DCT) processing for each block of non- 
compressed picture signals stored in the input buffer to obtain a plurality of blocks of discrete cosine transform 
(DCT) coefficients and quantizing the DCT coefficients to obtain a plurality of blocks of quantized values; 
inverted DCT expanding means for performing an inverted DCT processing for the blocks of DCT coefficients 
obtained by the DCT compressing means to reproduce the blocks of non-compressed picture signals of the 4:2: 
0 color component type; 

frame picture storing means for storing each block of non-compressed picture signals of the 4:2:0 color component 
type reproduced by the inverted DCT expanding means as picture signals of a block of a referential frame, other 
non-compressed picture signals of the 4:2:0 color component type corresponding to a frame succeeding to the 
referential frame being stored in the input buffer; 

motion predicting means for calculating a motion vector indicating the motion of a picture according to one block 
of non-compressed picture signals of the current frame stored in the input buffer and the non-compressed picture 
signals of the 4:2:0 color component type of the referential frame stored in the frame picture storing means for 
each block of the current frame and calculating an inter-frame difference between one block of non -com pressed 
picture signals of the current frame and a corresponding block of non-compressed picture signals of the referential 
frame indicated by the motion vector for each block of the current frame; 

coding selecting means for selecting a type of coding performed for the quantized values of the current frame 
obtained by the DCT compressing means; 

variable length coding means for performing a variable length coding for the quantized values obtained by the DCT 
compressing means according to the coding type selected by the coding selecting means, the motion vectors and 
the inter-frame differences calculated by the motion predicting means to produce pieces of variable length coded 
data; and 

structure coding means for producing the digital picture signals compressed in the MPEG format from the variable 
length coded data obtained by the variable length coding means. 

In the above configuration, the digital picture signals compressed in the DVC format are decoded to the non- 
30 compressed picture signals of the 4:1 :1 color component type, and the non-compressed picture signals of the 4:2:0 
color component type are coded to the digital picture signals compressed in the MPEG format. . 
Also, it is preferred that the motion predicting means comprise 

hierarchy picture producing means for producing a plurality of current hierarchy pictures of different resolutions 

35 from a current original picture of each block of the current frame indicated by one block of non-compressed picture 

signals stored in the input buffer and producing a plurality of referential hierarchy pictures from a referential original 
picture of each block of the referential frame indicated by one block of non-compressed picture signals stored in 
the frame picture storing means, a current hierarchy picture of the highest resolution being the current original 
picture, a current hierarchy picture of a resolution lower than that of a specific current hierarchy picture being 

40 obtained each time every other pixel is removed in an x direction from pixels of the specific current original picture 

and every other pixel is removed in a y direction from pixels of the specific current original picture, a referential 
hierarchy picture of the highest resolution being the referential original picture, and a referential hierarchy picture 
of a resolution lower than that of a specific referential hierarchy picture being obtained each time every other pixel 
is removed in an x direction from pixels of the specific referential original picture and every other pixel is removed 

45 in a y direction from pixels of the specific referential original picture; 

motion vector producing means for repeatedly calculating an intermediate motion vector from one current hierarchy 
picture and one referential hierarchy picture produced by the hierarchy picture producing means and a rough 
motion vector calculated just before the calculation of the intermediate motion vector while changing the current 
and referential hierarchy pictures of the same resolution to other current and referential hierarchy pictures of higher 

so resolution for each calculation of the intermediate motion vector and setting the intermediate motion vector as the 

rough motion vector for each calculation of the intermediate motion vector, and finally calculating the motion vector 
from the current and referential hierarchy pictures of the highest resolution, the motion vector being calculated for 
each block of the current frame, the motion vector for a block of the current frame indicating a block of the referential 
frame, and the rough motion vector indicating candidates for a particular block of the referential frame indicated 

55 by the intermediate motion vector; and 

inter-frame difference information producing means for producing inter-frame difference information indicating the 
inter-frame difference between a group of pixel values of one block of the current frame and a group of pixel values 
of a corresponding block of the referential frame indicated by the motion vector produced by the motion vector 
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producing means for each block of the current frame. 

In the above configuration, a plurality of current hierarchy pictures of different resolutions are produced from a 
current original picture of each block of the current frame, and a plurality of referential hierarchy pictures are produced 

s from a referential original picture of each block of the referential frame. Thereafter, an intermediate motion vector is 
repeatedly calculated from one current hierarchy picture and one referential hierarchy picture while changingthe current 
and referential hierarchy pictures to other current and referential hierarchy pictures of higher resolution for each cal- 
culation of the intermediate motion vector, and the motion vector is finally calculated from the current and referential 
hierarchy pictures of the highest resolution. In this case, the intermediate motion vector is set as a rough motion vector 

10 for each calculation of the intermediate motion vector, and the intermediate motion vector indicating a particular block 
of the referential frame is calculated while using the rough motion vector indicating candidates for the particular block 
of the referential frame. 

Thereafter, inter-frame difference information indicating the inter-frame difference between a group of pixel values 
of one block of the current frame and a group of pixel values of a corresponding block of the referential frame indicated 
15 by the motion vector is produced for each block of the current frame. 

Therefore, in cases where a large object is drawn in a natural picture, an intermediate motion vector roughly 
indicating the motion of the large object is calculated more precisely each time the intermediate motion vector is cal- 
culated. Therefore, a motion vector indicating the motion of the large object can be precisely calculated. 

Accordingly, even though a large object is dynamically moved in a moving picture, a motion vector faithfully ex- 
20 pressing a natural motion of the large object can be obtained. 

Also, because an intermediate motion vector calculated in a previous stage is used as a rough motion vector for 
the calculation of a next intermediate motion vector, a calculation volume required for the calculation of the motion 
vector can be considerably reduced even though the intermediate motion vector is repeatedly calculated by using the 
current hierarchy pictures and the referential hierarchy pictures. 
25 Also, it is preferred that the picture coding means further comprise: 

a DCT coefficient buffer for storing a block of DCT coefficients of luminance signals extracted from each block of 
DCT coefficients of the non-compressed picture signals produced by the inverted quantization means, each block 
of DCT coefficients of luminance signals corresponding to a block of the current frame, and the DCT coefficients 
of each block being arranged in a matrix of rows and columns; and 

hierarchical inverted DCT processing means for repeatedly extracting a group of DCT coefficients from each block 
of DCT coefficients of luminance signals stored in the DCT coefficient buffer on condition that a frequency band 
of the group of DCT coefficients gradually extends to a higher frequency and performing an inverted DCT process- 
ing for each group of DCT coefficients to produce a plurality of hierarchy pictures respectively indicated by a plurality 
of non-compressed luminance signals, the hierarchy pictures of different resolutions being produced for each block 
of the current frame, and 
the motion predicting means comprise 

motion vector producing means for repeatedly calculating an intermediate motion vector from one hierarchy picture 
produced by the hierarchical inverted DCT processing means and a referential original picture of the referential 
frame indicated by non-compressed luminance signals of the non-compressed picture signals stored in the frame 
picture storing means and a rough motion vector calculated just before the calculation of the intermediate motion 
vector while changing the hierarchy picture to another hierarchy picture of a higher resolution for each calculation 
of the intermediate motion vector and setting the intermediate motion vector as the rough motion vector for each 
calculation of the intermediate motion vector, and finally calculating the motion vector from the hierarchy picture 
of the highest resolution and the referential original picture for each block of the current frame, the motion vector 
for a block of the current frame indicating a block of the referential frame, and the rough motion vector indicating 
candidates for a particular block of the referential frame indicated by the intermediate motion vector; and 
inter-frame difference information producing means for producing inter-frame difference information indicating the 
inter-frame difference between a group of pixel values of one block of the current frame and a group of pixel values 
of a corresponding block of the referential frame indicated by the motion vector calculated by the motion vector 
producing means for each block of the current frame. 

In the above configuration, a plurality of hierarchy pictures of different resolutions indicated by a plurality of non- 
compressed luminance signals are produced for each block of the current frame. Thereafter, an intermediate motion 
55 vector is repeatedly calculated from one hierarchy picture and a referential original picture of the referential frame, and 
the motion vector is finally calculated from the current and referential hierarchy pictures of the highest resolution. In 
this case, the intermediate motion vector is set as a rough motion vector for each calculation of the intermediate motion 
vector, and the intermediate motion vector indicating a particular block of the referential frame is calculated while using 
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the rough motion vector indicating candidates for the particular block of the referential frame. 

Thereafter, inter-frame difference information indicating the inter-frame difference between a group of pixel values 
of one block of the current frame and a group of pixel values of a corresponding block of the referential frame indicated 
by the motion vector is produced for each block of the current frame. 
5 Accordingly, because the hierarchy pictures of different resolutions are produced for each block of the current 

frame and are used to calculate the motion vector, the motion vector faithfully indicating a motion of a picture can be 
precisely obtained. 

Also, it is preferred that the picture coding means further comprise: 

w a DCT coefficient buffer for storing a block of DCT coefficients of luminance signals extracted from each block of 

DCT coefficients of the non-compressed picture signals produced by the inverted quantization means, each block 
of DCT coefficients of luminance signals corresponding to a block of the current frame, and the DCT coefficients 
of each block being arranged in a matrix of rows and columns; and 

a onc-dtmensional inverted DCT processing means for extracting a block of DCT coefficients of luminance signals 
is arranged «n a row as an x-directional group of DCT coefficients from each block of DCT coefficients stored in the 

DCT coclhcicnt butler extracting a block of DCT coefficients of luminance signals arranged in a column as a y- 
directional group oi DCT coefficients from each block of DCT coefficients stored in the DCT coefficient buffer, 
performing an inverted DCT processing for the x-directional group of DCT coefficients to obtain x-directional in- 
formaton composed of non-compressed luminance signals arranged in the x direction for each block of a current 
20 frame and performing an inverted DCT processing for the y-directional group of DCT coefficients to obtain y- 

directional mloimation composed of non-compressed luminance signals arranged in the y direction for each block 
of the current frame, and 
the motion predicting means comprise 

motion vector producing means for calculating an x-directional motion vector according to the x-directional infor- 
ms mation obtained by the onc-dimcnsional inverted DCT processing means and non-compressed luminance signals 
of the non-compressed picture signals stored in the frame picture storing means for each block of the current 
frame, specifying a plurality of remarked blocks of the referential frame arranged in the neighborhood of a particular 
block indicated by the 

x-directional motion vector and calculating a motion vector according to the y-directional information obtained by 
30 the one-dimensional inverted DCT processing means and non-compressed luminance signals of the remarked 

blocks for each block of the current frame; and 

inter-frame difference information producing means for producing inter-frame difference information indicating the 
inter-frame difference between a group of pixel values of one block of the current frame and a group of pixel values 
of a corresponding block of the referential frame indicated by the motion vector calculated by the motion vector 
35 producing means for each block of the current frame. 

In the above configuration, x-directional information composed of non-compressed luminance signals arranged in 
the x direction is produced for each block of a current frame, and y-directional information composed of non-compressed 
luminance signals arranged in the y direction is produced for each block of the current frame. Thereafter, an x-directional 
40 motion vector is calculated according to the x-directional information and non -compressed luminance signals of a 
referential frame, and a motion vector is calculated according to the x-directional motion vector and the y-directional 
information. 

Accordingly, a calculation volume required for the calculation of the motion vector can be reduced as compared 
with a case that the hierarchy pictures are produced, and the motion vector faithfully indicating a motion of a picture 
45 can be precisely obtained. 

The second object is also achieved by the provision of a picture signal converting apparatus comprising: 

receiving means for receiving a digitaj picture signal compressed in a first format for each of pixels of a frame; 
picture decoding means for decoding the digital picture signals received by the receiving means to produce a 

so plurality of discrete cosine transform (DCT) coefficients of non-compressed picture signals of a 4:1:1 color com- 

ponent type, converting the DCT coefficients into a plurality of DCT coefficients of non-compressed picture signals 
of a 4:2:0 color component type and producing a plurality of non-compressed picture signals of the 4:2:0 color 
component type from the DCT coefficients of the non-compressed picture signals of the 4: 2:0 color component type; 
picture coding means for coding the non-compressed picture signals of the 4:2:0 color component type obtained 

ss by the picture decoding means to produce a plurality of digital picture signals compressed in a second format 

different from the first format; and 

output means for outputting the digital picture signals compressed in the second format obtained by the picture 
coding means. 
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In the above configuration, a plurality of digital picture signal compressed in a first format are decoded to a plurality 
of DCT coefficients of non-compressed picture signals of a 4: 1 :1 color component type, the DCT coefficients are con- 
verted into a plurality of DCT coefficients of non-compressed picture signals of a 4:2:0 color component type, a plurality 
of non-compressed picture signals of the 4:2:0 color component type are produced from the DCT coefficients of the 

5 non -compressed picture signals of the 4:2:0 color component type, and the non-compressed picture signals of the 4: 
2:0 color component type are coded to a plurality of digital picture signals compressed in a second format. 

Accordingly, because the DCT coefficients corresponding to the 4:1:1 color component type are converted into 
the DCT coefficients corresponding to the 4:2:0 color component type, it is not required to convert color difference 
signals of the 4:1:1 color component type into color difference signals of the 4:2:0 color component type. 

10 it is preferred that the first format be the DVC format, the second format be the MPEG format, and the picture 

decoding means comprises 

preparing means for deshuffling the digital picture signals to rearrange the digital picture signals; 
variable-length decoding means for performing a variable-length decoding for the digital picture signals deshuffled 

f5 by the preparing means to produce a plurality of quantized values; 

inverted quantization means for performing an inverted quantization for the quantized values produced by the 
variable-length decoding means to produce a plurality of blocks of discrete cosine transform (DCT) coefficients of 
the non-compressed picture signals of the 4:1 :1 color component type, the DCT coefficients of each block being 
arranged in a matrix of rows and columns; 

20 DCT coefficient converting means for extracting a block of DCT coefficients of non-compressed color difference 

signals of the 4:1:1 color component type from each block of DCT coefficients of the non -compressed picture 
signals obtained by the inverted quantization means and converting each block of DCT coefficients of the non- 
compressed color difference signals of the 4:1 :1 color component type to a block of DCT coefficients of non- 
compressed color difference signals of a 4:2:0 color component type by removing a lower half portion of DCT 

2S coefficients corresponding to higher frequency from each block of DCT coefficients to halve a resolution of the 

DCT coefficients in a y direction for each block and adding DCT coefficients on the right side of the remaining DCT 
coefficients for each block to double a resolution of the DCT coefficients in an x direction for each block; and 
inverted DCT processing means for performing an inverted DCT processing for each block of DCT coefficients of 
non -com pressed luminance signals extracted from the DCT coefficients of the non -compressed picture signals 

30 obtained by the inverted quantization means and a corresponding block of DCT coefficients of the non -compressed 

color difference signals of the 4:2:0 color component type obtained by the DCT coefficient.converting means to 
produce a plurality of blocks of non-compressed picture signals of the 4:2:0 color component type. 

In the above configuration, color difference information in each block of DCT coefficients is mainly expressed by 
35 lower frequency components placed on the upper left side of the block. Therefore, the conversion of a block of DCT 
coefficients of the non-compressed color difference signals of the 4:1:1 color component type into a block of DCT 
coefficients of non-compressed color difference signals of a 4:2:0 color component type is performed by removing a 
lower half portion of DCT coefficients corresponding to higher frequency from the block of DCT coefficients of the 4: 1 : 
1 color component type to halve a resolution of the DCT coefficients of the 4:1 :1 color component type in a y direction 
40 and adding DCT coefficients on the right side of the remaining DCT coefficients to double a resolution of the DCT 
coefficients of the 4:1 :1 color component type in an x direction. 

Accordingly, because color difference information existing in the block of DCT coefficients of the non-compressed 
color difference signals of the 4:1:1 color component type is maintained in the block of DCT coefficients of the non- 
compressed color difference signals of the 4:2:0 color component type. Therefore, any viewer does not feel an unnatural 
45 color change in a reproduced picture obtained from the digital picture signals compressed in the MPEG format. 

The above f eatu res of the present invention are also obtained by the provision of a picture signal converting method, 
comprising the steps of: 

receiving a digital picture signal compressed in a DVC format for each of pixels of a frame, the digital picture signals 
so compressed in the DVC format being obtained by performing a discrete cosine transform (DCT) processing for 

each block of non-compressed picture signals of a 4: 1 : 1 color component type to obtain a block of DCT coefficients 
from each block of non-compressed picture signals, quantizing each block of DCT coefficients to obtain a block 
of quantized values from each block of DCT coefficients, coding each block of quantized values to obtain a block 
of variabie-length codes from each block of quantized values and recording each block of variable-length codes 
55 as the digital picture signals compressed in the DVC format; 

performing a variable-length decoding for the digital picture signals compressed in the DVC format to produce a 
plurality of quantized values; 

performing an inverted quantization for the quantized values to produce a plurality of blocks of discrete cosine 
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transform (DCT) coefficients of the non-compressed picture signals of the 4: 1 :1 color component type, each block 
of DCT coefficients of the non -compressed picture signals being classified into a block of DCT coefficients of non- 
compressed luminance signals and a block of DCT coefficients of the non-compressed color difference signals of 
the 4:1:1 color component type; 
s converting each block of DCT coefficients of the non-compressed color difference signals of the 4:1:1 color com- 

ponent type into a block of DCT coefficients of non -compressed color difference signals of a 4:2:0 color component 
type, the DCT coefficients of each block being arranged in a matrix of rows and columns; 

combining each block of DCT coefficients of the non-compressed color difference signals of the 4:2:0 color com- 
ponent type and a corresponding block of DCT coefficients of non-compressed luminance signals to produce a 
10 plurality of blocks of DCT coefficients of non-compressed picture signals of the 4:2:0 color component type; 

performing an inverted DCT processing for each block of DCT coefficients of non -compressed picture signals of 
the 4:2:0 color component type to produce a block of non-compressed picture signals of the 4:2:0 color component 
type for each block of DCT coefficients, 

coding each block of non-compressed picture signals of the 4:2:0 color component type to produce a plurality of 
is digital picture signals compressed in a moving picture experts group (MPEG) format in which a time-redundancy 

between frames is reduced by performing a motion compensation, a space-redundancy in each frame is reduced 
by performing a discrete cosine transform and a code volume is reduced by performing a variable length coding; and 
outputting the digital picture signals compressed in the MPEG format, and 
the step of converting each block of DCT coefficients comprises the steps of: 
20 removing a lower hall portion of DCT coefficients corresponding to higher frequency from each block of DCT 

coefficients to halve a resolution of the DCT coefficients in a y direction for each block; and 
adding DCT coefficients on the right side of the remaining DCT coefficients for each block to double a resolution 
of the DCT coefficients in an x direction for each block and to produce the blocks of DCT coefficients of the non- 
compressed color difference signals of the 4:2:0 color component type. 

25 

The third object is achieved by the provision of a picture providing system, comprising: 

picture input means for receiving a plurality of digital picture signals compressed in a first format; 

picture reproducing means for reproducing a digital picture according to a plurality of digital picture signals com- 

30 pressed in a second format different from the first format; 

picture providing means for receiving the digital picture signals compressed in the first format from the picture input 
means, converting the digital picture signals compressed in the first format into the digital picture signals com- 
pressed in the second format and transmitting the digital picture signals compressed in the second format to the 
picture reproducing means; and 

35 a network through which the digital picture signals compressed in the first format is transmitted from the picture 

input means to the picture providing means and the digital picture signals compressed in the second format is 
transmitted from the picture providing means to the picture reproducing means, 
the picture providing means comprising: 

communicating means for receiving the digital picture signals compressed in the first format from the picture input 
40 means through the network and outputting the digital picture signals compressed in the second format to the picture 

reproducing means through the network; and 

picture signal converting means for converting the digital picture signals of the first format received by the com- 
municating means into the digital picture signals compressed in the second format and outputting the digital picture 
signals compressed in the second format to the communicating means, and 

45 the picture signal converting means comprising 

picture decoding means for decoding the digital picture signals compressed in the first format to produce a plurality 
of non-compressed picture signals of a 4:1:1 color component type, the non -compressed picture signals being 
arranged in a matrix of rows and columns; 
' component signal converting means for directly converting color difference signals of the non-compressed picture 

so signals obtained by the picture decoding means into converted color difference signals of a 4:2:0 color component 

type by removing color difference signals on every other row from the color difference signals of the non-com- 
pressed picture signals to halve the number of color difference signals in a y direction and adding a color difference 
signal to a position between each pair of color difference signals adjacent to each other in an x direction to double 
the number of color difference signals in the x direction, setting values of the converted color difference signals of 

55 the 4:2:0 color component type according to values of the color difference signals of the non-compressed picture 

signals obtained by the picture decoding means and combining luminance signals of the non-compressed picture 
signals obtained by the picture decoding means and the converted color difference signals of the 4:2:0 color com : 
ponent type obtained by the color difference signal converting means for each pixel of the frame to produce non- 



17 



BNSDOCIO <EP_0862339A2_I_> 



EP 0 862 339 A2 



compressed picture signals of the 4:2:0 color component type; and 

picture coding means for coding the non-compressed picture signals ot the 4:2:0 color component type obtained 
by the component signal converting means to produce the digital picture signals compressed in the second format. 

s In the above configuration, a plurality of digital picture signals compressed in a first format transmitted from the 

picture input means are received in the picture providing means. In the picture providing means, the digital picture 
signals are decoded to a plurality of non-compressed picture signals of a 4:1 :1 color component type, the non-com- 
pressed picture signals are directly converted into a plurality of non-compressed picture signals of a 4:2:0 color com- 
ponent type, and the n on -compressed picture signals of the 4:2:0 color component type are coded to a plurality of 
io digital picture signals compressed in a second format. Thereafter, when the picture reproducing means request the 
digital picture signals compressed in the second format of the picture providing means, the digital picture signals com- 
pressed in the second format are transmitted to the picture reproducing means and are reproduced. 

Therefore because the direct conversion is performed by the picture providing means, even though a compression 
format of the digital picture signals required by the picture reproducing means differs from that of the digital picture 
*5 signals transmuted from the picture input means, the digital picture signals of the second format required by the picture 
reproducing means can be provided for the picture input means. 

The third object is also achieved by the provision of a picture providing system, comprising: 

picture input means for receiving a plurality of digital picture signals compressed in a first format; 
picture reproducing means for reproducing a digital picture according to a plurality of digital picture signals com- 
pressed in a second format different from the first format; 

picture providing means for receiving the digital picture signals compressed in the first format from the picture input 
means, converting the digital picture signals compressed in the first format into the digital picture signals com- 
pressed in the second format and transmitting the digital picture signals compressed in the second format to the 
picture reproducing moans; and 

a network through which the digital picture signals compressed in the first format is transmitted from the picture 
input means to the picture providing means and the digital picture signals compressed in the second format is 
transmitted from the picture providing means to the picture reproducing means, 
the picture providing means comprising: 

communicating means for receiving the digital picture signals compressed in the first format from the picture input 
means through the network and outputting the digital picture signals compressed in the second format to the picture 
reproducing means through the network; and 

picture signal converting means for converting the digital picture signals of the first format received by the com- 
municating means into the digital picture signals compressed in the second format and outputting the digital picture 
signals compressed in the second format to the communicating means, and 
the picture signal converting means comprising 

picture decoding means for decoding the digital picture signals of the first format to produce a plurality of discrete 
cosine transform (DCT) coefficients of non-compressed picture signals of a 4:1 :1 color component type, converting 
the DCT coefficients into a plurality of DCT coefficients of non-compressed picture signals of a 4:2:0 color com- 
ponent type and producing a plurality of non-compressed picture signals of the 4:2:0 color component type from 
the DCT coefficients of the non-compressed picture signals of the 4:2:0 color component type; and 
picture coding means for coding the non-compressed picture signals of the 4:2:0 color component type obtained 
by the picture decoding means to produce the digital picture signals compressed in the second format. 

45 in the above configuration, a plurality of digital picture signals of a first format transmitted from the picture input 

means to the picture providing means are decoded to a plurality of DCT coefficients of n on -compressed picture signals 
of a 4: 1 : 1 color component type, the DCT coefficients are directly converted into a plurality of DCT coefficients of non- 
compressed picture signals of a 4:2:0 color component type, an inverted DCT processing is performed for the DCT 
coefficients of the non -compressed picture signals of the 4:2:0 color to produce a plurality of non-compressed picture 

so signals of the 4:2:0 color component type component type, and the non-compressed picture signals of the 4:2:0 color 
component type are coded to a plurality of digital picture signals compressed in a second format. 

Therefore, because the direct conversion is performed by the picture providing means, even though a compression 
format of the digital picture signals required by the picture reproducing means differs from that of the digital picture 
signals transmitted from the picture input means, the digital picture signals of the second format required by the picture 

55 reproducing means can be provided for the picture input means. 

The features and advantages of the present invention will be apparent from the following description taken in 
conjunction with the accompanying drawings, in which: 
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Fig. 1 A shows the correspondence of a luminance signal Y to color difference signals Cr and Cb in the 4:4:4 color 
component type digital picture signal; 

Fig. 1B shows the comparison of information volumes of the luminance signal Y and the color difference signals 
Cr and Cb in the 4:4:4 color component type digital picture signal; 
5 Fig. 2A shows the correspondence of a luminance signal Y to color difference signals Cr and Cb in the 4:2:2 color 

component type digital picture signal; 

Fig. 2B shows the comparison of information volumes of the luminance signal Y and the color difference signals 
Cr and Cb in the 4:2:2 color component type digital picture signal; 

Fig. 3A shows the correspondence of a luminance signal Y to color difference signals Cr and Cb in the 4:2:0 color 
w component type digital picture signal; 

Fig. 3B shows the comparison of information volumes of the luminance signal Y and the color difference signals 
Cr and Cb in the 4:2:0 color component type digital picture signal; 

Fig. 4A shows the correspondence of a luminance signal Y to color difference signals Cr and Cb in the 4: 1 :1 color 
component type digital picture signal; 
is Fig. 4B shows the comparison of information volumes of the luminance signal Y and the color difference signals 

Cr and Cb in the 4:1:1 color component type digital picture signal; 
Fig. 5 is a block diagram of a conventional MPEG data producing apparatus; 

Fig. 6 is a block diagram of a picture signal converting apparatus according to a first embodiment of the present 
invention; 

20 Fig. 7 is a flow chart showing the whole processing performed in the picture signal converting apparatus shown 

in Fig. 6; 

Fig. 8A shows a plurality of values of 4:1:1 type luminance signals Y corresponding to 8*4 pixels placed at a sub- 
frame; 

Fig. 8B shows a plurality of values of 4:1 :1 type first color difference signals Cr corresponding to the luminance 
25 signals Y; 

Fig. 8C shows a plurality of values of 4: 1 : 1 type second color difference signals Cb corresponding to the luminance 
signals Y; 

Fig. 8D shows a plurality of values of 4:2:0 type first converted color difference signals Cr' corresponding to the 
luminance signals Y; 

30 Fig. BE shows a plurality of values \fi of 4:2:0 type second converted color difference signals Cb' corresponding 

to the luminance signals Y; 

Fig. 9A is a block diagram of a color difference signal converting unit shown in Fig. 6 in a first color difference 
signal converting method; 

Fig. 9B is a block diagram of a color difference signal converting unit shown in Fig. 6 in a second color difference 
35 signal converting method; 

Fig. 9C is a block diagram of a color difference signal converting unit shown in Fig. 6 in a third color difference 
signal converting method; 

Fig. 9D is a block diagram of a color difference signal converting unit shown in Fig. 6 in a fourth color difference 
signal converting method; 
40 Fig. 10A shows a plurality of values of 4:2:2 type luminance signals Y; 

Fig. 10B shows a plurality of values of the 4:2:2 type color difference signals Cr and Cb; 

Fig. 10C shows a plurality of values of the 4:1:1 type color difference signals Cr and Cb compressed in the DV 
compression format; 

Fig. 1 1 A shows a first actual example of values of 4: 1 : 1 type color difference signals Cr (or Cb) input to the picture 

45 signal converting unit shown in Fig. 6; 

Fig. 1 1 B shows a first actual example of values of 4:2:0 type converted color difference signals Cr* (or Cb') output 
from the picture signal converting unit in the first color difference signal converting method; 
Fig. 11 C shows a first actual example of values of 4:2:0 type converted color difference signals Cr* (or Cb') output 
from the picture signal converting unit in the second color difference signal converting method; 

so Fig. 1 1 D shows a first actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb 1 ) output 

from the picture signal converting unit in the third color difference signal converting method; 
Fig. 1 1 E shows a first actual example of values of 4:2:0 type converted color difference signals Cr* (or Cb') output 
from the picture signal converting unit in the fourth color difference signal converting method; 
Fig. 12A shows a second actual example of values of 4:1:1 type color difference signals Cr (or Cb) input to the 

55 picture signal converting unit shown in Fig. 6; 

Fig. 12B shows a second actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb 1 ) 

output from the picture signal converting unit in the first color difference signal converting method; 

Fig. 1 2C shows a second actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb') 
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output from the picture signal converting unit in the second color difference signal converting method; 

Fig. 12D shows a second actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb') 

output from the picture signal converting unit in the third color difference signal converting method; 

Fig. 12E shows a second actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb') 

output from the picture signal converting unit in the fourth color difference signal converting method; 

Fig. 1 3A shows a third actual example of values of 4:1 : 1 type color difference signals Cr (or Cb) input to the picture 

signal converting unit shown in Fig. 6; 

Fig. 1 3B shows a third actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb') output 

from the picture signal converting unit in the first color difference signal converting method; 

Fig. 1 3C shows a third actual example of values of 4:2:0 type converted color difference signals Cr 1 (or Cb') output 

from the picture signal converting unit in the second color difference signal converting method; 

Fig. 1 3D shows a third actual example of values of 4:2:0 type converted color difference signals Cr 1 (or Cb') output 

from the picture signal converting unit in the third color difference signal converting method; 

Fig. 1 3E shows a third actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb 1 ) output 

from the picture signal converting unit in the fourth color difference signal converting method; 

Fig. 14 is a block diagram of a picture signal converting apparatus according to a second embodiment of the 

present invention; 

Fig. 15 is a flow chart showing the whole processing performed in the picture signal converting apparatus shown 
in Fig. 14; 

Fig. 16A is a block diagram of a color difference signal converting unit shown in Fig. 14 in a fifth color difference 
signal converting method; 

Fig. 16B is a block diagram of a color difference signal converting unit shown in Fig. 14 in a sixth color difference 
signal converting method; 

Fig. 17A shows an actual example of values of 4:1 :1 type luminance signals Y; 

Fig. 17B shows an actual example of values of 4:1:1 type color difference signals Cr (or Cb) input to a picture 
signal converting unit shown in Fig. 14; 

Fig. 17C shows an actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb') output 

from the picture signal converting unit in the fifth color difference signal converting method; 

Fig 17D shows an actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb') output 

from the picture signal converting unit in the sixth color difference signal converting method; 

Fig. 17E shows an actual example of values of 4:2:0 type converted color difference signals Cr' (or Cb') output 

from the picture signal converting unit in the first color difference signal converting method of the first embodiment; 

Fig. 18 is a block diagram of a picture signal converting apparatus according to a third embodiment of the present 

invention; 

Fig. 19 shows the whole procedure performed in the picture signal converting apparatus shown in Fig. 18; 

Fig. 20 is a flow chart of a decoding processing performed in the picture signal converting apparatus shown in Fig. 

18; 

Fig. 21 is a flow chart of a picture signals coding processing performed in the picture signal converting apparatus 
shown in Fig. 18; 

Fig. 22 shows an example of a plurality of hierarchy pictures used in a motion prediction; 
Fig. 23 is a block diagram of a motion predicting unit shown in Fig. 18; 

Fig. 24 is a flow chart showing a motion vector calculating method using a plurality of hierarchy pictures; 
Figs. 25A and 25B show the motion vector calculating method; 

Fig. 26 is a block diagram of a picture signal converting apparatus according to a fourth embodiment; 
Fig. 27 is a block diagram ol a motion predicting unit shown in Fig. 26; 

Fig. 28 is a flow chart showing a picture signal decoding (or expanding) processing performed in a picture signal 
decoding unit shown in Fig. 26; 

Fig. 29 is a flow chart showing a picture signal compressing processing performed in a picture signal coding unit 
shown in Fig. 26; 

Figs. 30A to 30D show a hierarchical inverted DCT processing performed in the picture signal converting apparatus 
shown in Fig. 26; 

Fig. 31 shows another hierarchical inverted DCT processing performed in the picture signal converting apparatus 
shown in Fig. 26; 

Fig. 32 is a block diagram o1 a picture signal converting apparatus according to a fifth embodiment; 
Fig. 33 is a block diagram of a motion predicting unit shown in Fig. 32; 

Fig. 34 is a flow chart showing a picture signal compressing processing performed in a picture signal decoding 
unit shown in Fig. 26; 

Fig. 35 shows a one-dimensional inverted DCT processing and a motion prediction performed in a picture signal 
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decoding unit shown in Fig. 26; 

Fig. 36 shows the detection of a motion vector in the one-dimensional inverted DCT processing; 
Fig. 37 is a block diagram ot a picture signal converting apparatus according to a seventh embodiment; 
Fig. 38 is a flow chart showing the whole processing performed in the picture signal converting apparatus shown 
5 in Fig. 37; 

Fig. 39 is a flow chart showing a picture decoding processing performed in a picture signal decoding unit shown 
in Fig. 37; 

Fig. 40 shows a component type conversion from 4: 1 : 1 type to 4:2:0 type in a DCT coefficient converting processing 
and an inverted DCT processing for DCT coefficients of 4:2:0 type color difference signals; 
io Fig. 41 is a block diagram of a picture signal converting apparatus according to a modification of the seventh 

embodiment; 

Fig. 42 is a block diagram of a picture signal converting apparatus according to another modification of the seventh 
embodiment; 

Fig. 43 is a block diagram of a multi-format picture providing system according to a sixth embodiment; 

75 Fig. 44A is a flow chart showing a picture inputting processing performed in a picture providing unit shown in Fig. 43; 

Fig. 44B is a flow chart showing a picture outputting processing performed in the picture providing unit; 
Fig. 45A is a flow chart showing another picture inputting processing performed in the picture providing unit in 
cases where a picture signal converting processing is performed at a speed higher than a real time speed; and 
Fig. 45B is a flow chart showing another picture outputting processing performed in the picture providing unit in 

20 cases where a picture signal converting processing is performed at a speed higher than a real time speed. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 

Preferred embodiments of a picture signal converting apparatus, a picture signal converting method and a picture 
25 providing system according to the present invention are described with reference to the drawings. 



(First Embodiment) 

In this embodiment, a picture signal converting apparatus and a picture signal converting method in which a 4:1: 
30 1 color component type digital picture signal (hereinafter, called a 4:1:1 type component picture signal) is directly 
converted into a 4:2:0 color component type digital picture signal (hereinafter, called a 4:2:0 type component picture 
signal) are described. 

Fig. 6 is a block diagram of a picture signal converting apparatus according to a first embodiment of the present 
invention, and Fig. 7 is a flow chart showing the whole processing performed in the picture signal converting apparatus. 
35 As shown in Fig. 6, a picture signal converting apparatus 11 comprises 

an input unit 12 for receiving 4:1:1 type component picture signals of one frame for each frame, 
an Y frame memory 1 3 for storing luminance signals Y of the 4:1 :1 type component picture signals (hereinafter, 
called 4:1:1 type luminance signals) for each frame, 
40 an input Cr frame memory 1 4 for storing first color difference signals Cr of the 4: 1 : 1 type component picture signals 

(hereinafter, called 4: 1 : 1 type first color difference signals) for each frame on condition that the first color difference 
signals Cr are placed at Cr co-ordinates (x.y) of an X-Y co-ordinate system, 

an input Cb frame memory 15 for storing second color difference signals Cb of the 4:1:1 type component picture 
signals (hereinafter, called 4: 1 : 1 type second color difference signals) for each frame on condition that the second 

45 color difference signals Cb are placed at Cb co-ordinat es (x,y) of an X-Y co-ordinate system, 

a color difference signal converting unit 16 for converting the 4:1:1 type first color difference signals Cr into first 
converted color difference signals Cr' of 4:2:0 type component picture signals (hereinafter, called 4:2:0 type first 
converted color difference signals) for each frame and converting the second color difference signals Cb into 
second converted color difference signals Cb* of the 4:2:0 type component picture signals (hereinafter, called 4: 

so 2:0 type second converted color difference signals) for each frame, 

an output Cr frame memory 17 for storing the 4:2:0 type first converted color difference signals Cr' for each frame 
on condition that the 4:2:0 type first converted color difference signals Cr* are placed at Cr* co-ordinates (x,y) of 
an X-Y co-ordinate system, 

an output Cb frame memory 16 for storing the 4:2:0 type second converted color difference signals Cb' for each 
55 frame on condition that the 4:2:0 type second converted color difference signals Cb' are placed at Cb* co-ordinates 

(x,y) of an X-Y co-ordinate system, and 

an output unit 19 for outputting the 4:2:0 type component picture signals composed of the luminance signals Y 
stored in the Y frame memory 13, the 4:2:0 type first converted color difference signals Cr* and the 4:2:0 type 
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second converted color difference signals Co' for each frame. 

In the above configuration, an operation performed in the picture signal converting apparatus 11 is described in 
brief with reference to Fig. 7. 

5 As shown in Fig. 7, in a step SI 01 : a processing frame of a moving picture is specified, the input unit ,12 receives 

a plurality of 4:1 :1 type component picture signals of the processing frame, a plurality of 4:1:1 type luminance signals 
Y are stored in the Y frame memory 1 3, a plurality of 4:1 :1 type first color difference signals Cr are stored in the input 
Cr frame memory 14, and a plurality of 4:1 :1 type second color difference signals Cb are stored in the input Cb frame 
memory 15. 

w in a step SI 02, the color difference signals Cr and Cb stored in the input Cr frame memory 1 4 and the input Cb 

frame memory 15 are input to the color difference signal converting unit 16 and are converted into color difference 
signals Cr' and Cb' of a plurality of 4:2:0 type component picture signals according to a first color difference signal 
converting method, a second color difference signal converting method, a third color difference signal converting meth- 
od or a fourth color difference signal converting method. Thereafter, the first converted color difference signals Cr' are 
'5 stored in the output Cr frame memory 1 7, and the second converted color difference signals Cb' are stored in the output 
Cb frame memory 18. 

In a step SI 03, the luminance signals Y stored in the Y frame memory 13, the first converted color difference 
signals Cr' stored in the output Cr frame memory 17 and the second converted color difference signals Cb' stored in 
the output Cb frame memory 16 are combined in the output unit 19 to produce a plurality of 4:2:0 type component 
20 picture signals of the processing Irame, and the 4:2:0 type component picture signals are output from the output unit 1 9. 

In a step S104, it is judged whether or not the processing frame is a final frame of the moving picture. In cases 
where the processing frame is a final frame of the moving picture, the operation is finished. In cases where the process- 
ing frame is not a final frame of the moving picture, a next frame is newly specified as a processing frame, and the 
steps S101 to S 104 are repeated for the processing frame newly specified. 
25 Each of the color difference signal converting methods performed in the step S102 is described in detail with 

reference to Figs. 8 to 10. 

Fig. 8A shows a plurality of values Y x y of luminance signals Y corresponding to 8*4 pixels placed at one sub-frame 
(8 columns * 4 rows) of the processing frame, Fig. 8B shows a plurality of values U 1 x y of 4: 1 :1 type first color difference 
signals Cr corresponding to the luminance signals Y Fig. 8C shows a plurality of values V 1 x#y of 4:1:1 type second 
30 color difference signals Cb corresponding to the luminance signals Y Fig. 8D shows a plurality of values U 2 X y of 4:2: 
0 type first converted color difference signals Cr' corresponding to the luminance signals Y, and Fig. 8E shows a plurality 
of values V 2 ^ of 4:2:0 type second converted color difference signals Cb' corresponding to the luminance signals Y 
Here, x=0,1 ,2,- and y=0,1 ,2,- are satisfied. 

An X-Y co-ordinate system having an original point (0,0) at its top left is considered for each type of signals Y, Cr, 
35 Cb, Cr' and Cb', a luminance value of the luminance signal Y corresponding to the pixel placed at co-ordinates (x,y) 
is indicated by Y x , a value of the 4:1 :1 type first color difference signal Cr corresponding to the luminance signals of 
the values Y 4xy , Y 4x+1 y Y 4x+2y and Y 4x+3y is indicated by U 1 xy , a value of the 4:1:1 type second color difference 
signal Cb corresponding to the luminance signals of the values Y 4x y Y 4x+1 y Y 4x+2y and Y 4x+3y is indicated by V 1 x y , 
a value of the 4:2:0 type first converted color difference signal Cr' corresponding to the luminance signals of the values 
40 Y 2x.2y. Y 2x+1 .2y. Y 2x.2y+1 and Y 2x+i.2y+i is indicated by V 1 x y , a value of the 4:2:0 type second converted color difference 
signal Cb' corresponding to the luminance signals of the values Y 2x2y Y 2x+K2y Y 2x.2y+1 and Y 2x+i.2y+i ' s indicated by 
V 2 

x.y. 

Because the processing frame is composed of a plurality of sub-frames, the color difference signal converting 
processing is performed for each sub-frame in the step S102. 
45 in the first color difference signal converting method, as shown in Fig. 9A, the color difference signal converting 

unit 16 comprises 

a y-directional signal halving unit 1 6a for removing first color difference signals Cr on every other row from the first 
color difference signals stored in the input Cr frame memory 1 4 to halve the number of first color difference signals 
Cr in the y direction and removing second color difference signals Cb on every other row from the second color 
difference signals stored in the input Cb frame memory 15 to halve the number of second color difference signals 
Cb in the y direction; and 

an x -directional signal doubling unit 16b for adding a first color difference signal to a position between each pair 
of first color difference signals Cr which are obtained in the y-directional signal halving unit 16a and are adjacent 
to each other in the X direction, setting a value of one added first color difference signal to a value of one first color 
difference signal Cr adjacent to the added first color difference signal in the x direction for each added first color 
difference signal to double the number of first color difference signals Cr obtained in the y-directional signal halving 
unit 1 6b in the x direction, adding a second color difference signal to a position between each pair of second color 
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difference signals Cb which are obtained in the y-directional signal halving unit 1 6a and are adjacent to each other 
in the X direction, setting a value of one added second color difference signal to a value of one second color 
difference signal Cr adjacent to the added second color difference signal in the x direction for each added second 
color difference signal to double the number of second color difference signals Cb obtained in the y-directional 
s signal halving unit 16b in the x direction, outputting the first color difference signals as the 4: 2:0 type first converted 

color difference signals Cr' of the 4:2:0 color component type and outputting the second color difference signals 
obtained by the x-directional signal doubling unit 16b as the 4:2:0 type second converted color difference signals 
Cb'. 

10 in the above configuration, in the halving unit 1 6a ; odd numbered color difference signals Cr and Cb (having values 

u1 x 2y+i and v1 x 2y+i) P laced at odd-numbered y co-ordinate values or even-numbered color difference signals Cr and 
Cb (having values U 1 x ^ and v1 x 2y) P lac e d at even-numbered y co-ordinate values are removed from the 4:1:1 type 
color difference signals Cr and Cb stored in the frame memories 14 and 15 to halve the number of first (or second) 
color difference signals Cr (or Cb) in the y direction. Thereafter, in the doubling unit 16b, a first (or second) color 

is difference signal Cr (or Cb) is added to a position between each pair of first (or second) color difference signals Cr (or 
Cb) adjacent to each other in the X direction, and a value of one added first (or second) color difference signal is set 
to a value of one first (or second) color difference signal Cr (or Cb) adjacent to the added first (or second) color difference 
signal in the x direction to double the number of first (or second) color difference signals Cr (or Cb) in the x direction. 
Thereafter, the first (or second) color difference signals Cr (or Cb) are output as first (or second) converted color 

20 difference signals Cr* (or Cb')- That is, a resolution of the converted color difference signals Cr' and Cb' in the y direction 
(or longitudinal direction) is halved in the halving unit 16a, and a resolution of the converted color difference signals 
Cr" and Cb' in the x direction (or lateral direction) is doubled in the doubling unit 1 6b by setting a value U 1 x 2 y ( or V 1 x.2y) 
of each first (or second) color difference signal Cr (or Cb) placed at co-ordinates (x,2y) as values U 2 2x. y and u2 2x+i.y 
(or V 2 2x+n ) of two first (or second) converted color difference signal Cr' (or Cb') placed at co-ordinates (2x,y) and (2 

25 x+ 1,y). X+ y 

In cases where the odd-numbered color difference signals Cr and Cb having values U 1 x 2 y+i and v x.2y+i are 
removed, the even-numbered color difference signals Cr and Cb having values U 1 x 2y and V 1 x 2y remain, and values 
of converted color difference signals Cr* and Cb' are determined according to a signal conversion equation (1 ). 

30 2 2 1 

U 2x.y = U 2x+1 .y " U *.2y 

^2x y = ^2x + 1.y = v1 x.2y ( 1 > 

35 The signal conversion equation (1) indicates that any arithmetic calculation is not required to convert the 4:1:1 

type color difference signals Cr and Cb into the 4:2:0 type color difference signals Cr' and Cb*. 

For example : as shown in Figs. 8A to 8E, in cases where color difference signals Cr and Cb corresponding to 
luminance signals Y of one sub-frame composed of 8*4 pixels are input to the color difference signal converting unit 
16, values of 4:2:0 type converted color difference signals Cr' and Cb' are determined as follows. 



40 



U 2 o.o = u2 i.o = u1 o.o. U 2 2 . 0 = U 2 3 .o = u\_ 0 , uV, = U 2 V1 = UV 2 . 



u 2 = u 2 =u 1 



45 u 2.1 - u 3.1 ~ u 1.2' 0.0 - v 1.0 - v 0.0' v 2.0 ~ v 3.0 _ v 1.0 1 

^0.1= V 2 !., = V1 0.2 a " d ^2.1 = ^3., = V \.2 

so Also, in cases where the even-numbered color difference signals Cr and Cb having values U 1 x2y and V 1 x2 y are 

removed, the odd-numbered color difference signals Cr and Cb having values U 1 x 2y +1 and V 1 x 2y +1 remain, and values 
of converted color difference signals Cr* and Cb* are determined according to a signal conversion equation (1)'. 

N 2 - l J 2 — l J 1 

55 2x.y - u 2x+1,y ~ u x.2y+1 

x/2 _ u 2 -v 1 0)' 
v 2x.y ~ v 2x+1.y ~ v x.2y+1 x ' . 
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Accordingly, in cases where 4: 1 :1 type component picture signals are directly converted into 4:2:0 type component 
picture signals, this conversion can be easily performed because any arithmetic calculation such as addition, substrac- 
tion, multiplication or division is not required. 

In general, when 4:2:2 type component picture signals indicating a picture are input to a digital video apparatus 
5 to record the picture in the apparatus by converting 4:2:2 type color difference signals into 4:1:1 type color difference 
signals compressed in the DV compression format, each 4:1:1 type color difference signal is produced by removing 
one 4:2:2 type color difference signal placed on the right side from two 4:2:2 type color difference signals adjacent to 
each other in the x direction. The production of the 4:1:1 type color difference signals is, for example, shown in Figs. 
10A to IOC. 

w Fig. 1 0A shows a plurality of values Y x y of 4:2:2 type luminance signals Y input to the digital video apparatus, Fig. 

1 0B shows a plurality of values U 1 x y and x y of the 4:2:2 type color difference signals Cr and Cb, and Fig. 1 0C shows 
a plurality of values of the 4:1:1 type color difference signals Cr and Cb compressed in the DV compression format 

As shown in Figs. 1 0A to 1 0C, 4:2:2 type color difference signals having values U 1 2x+i . y and V 1 gx+i . y are removed 
in the digital video apparatus to produce 4:1 :1 type color difference signals. Therefore, for example, the value U 1 0 0 of 

is the 4:2:2 type color difference signal shown in Fig. 10B is used as the values U 2 00 and U 2 ^ 0 of the 4:2:0 type color 
difference signal shown in Fig. 8D without any signal converting arithmetic calculation, the value U 1 2 0 of tne 4:2:2 type 
color difference signal shown in Fig. lOB is used as the values U 2 2 0 and U 2 3 0 of the 4:2:0 type color difference signal 
shown in Fig. 8D without any signal converting arithmetic calculation, the value U 1 0<1 of the 4:2:2 type color difference 
signal shown in Fig. 10B is used as the values U 2 0 A and U 2 1 -, of the 4:2:0 type color difference signal shown in Fig. 

20 SO without any signal converting arithmetic calculation, and the value U 1 21 of the 4:2:2 type color difference signal 
shown in Fig. 10B is used as the values U 2 2 A and U 2 3 A of the 4:2:0 type color difference signal shown in Fig. 8D 
without any signal converting arithmetic calculation. 

Accordingly, in cases where 4:2:2 type component picture signals indicating a picture are input to a digital video 
apparatus to record the picture in the digital video apparatus by converting 4:2:2 type color difference signals into 4: 

25 1;1 type color difference signals compressed in the DV compression format and the 4: 1 : 1 type color difference signals 
are converted into 4:2:0 type component picture signals compressed according to MPEG1 or MPEG2, because the 
value U 1 10 of the 4:2:2 type color difference signal is not used as the values U 2 20 and u2 3.o of tne 4 -2:0 type color 
difference signal but the value U 1 2 0 of the 4:2:2 type color difference signal is used as the values U 2 2 0 and U 2 3 0 of 
the 4:2:0 type color difference signal, color information of the 4:2:2 type color difference signals can be faithfully main- 

30 tained in the 4:2:0 type component picture signals. 

Also, because any arithmetic calculation is not required to convert 4:2:2 type color difference signals into 4:2:0 
type color difference signals, the color signal converting operation can be easily performed in this first color difference 
signal converting method. 

Next, the second color difference signal converting method performed in the step S1 02 is described with reference 
35 to Figs. 8Ato8E. 

In the second color difference signal converting method, as shown in Fig. 9B, the color difference signal converting 
unit 16 comprises: 

a signal value setting unit 16c for setting values of two first color difference signals Cr of co-ordinates (x,2y) and 
(x,2y+1 ) (or (x,2y+1 ) and (x,2y+2)) adjacent to each other in the y direction to a first average of values of the first 
color difference signals Cr of the co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1) and (x,2y+2)) for each pair of first 
color difference signals Cr of co-ordinates (x,2y) and (x, 2y+1 ) (or (x,2y+1 ) and (x,2y+2)) and setting values of two 
second color difference signals Cb of co-ordinates (x,2y) and (x,2y+1 ) (or (x,2y+1 ) and (x,2y+2)) adjacent to each 
other in the y direction to a second average of values of the second color difference signals Cb of the co-ordinates 
(x,2y) and (x,2y+1) (or (x,2y+1 ) and (x,2y+2)) for each pair of second color difference signals Cb of co-ordinates 
(x,2y) and (x, 2y+1 ) (or (x,2y+1 ) and (x,2y+2)), 

the y-directional signal halving unit 16a for removing first color difference signals Cr on every other row from the 
first color difference signals, of which the values are set in the signal value setting unit 16c, to halve the number 
of first color difference signals Cr in the y direction and removing second color difference signals Cr on every other 
row from the second color difference signals, of which the values are set in the signal value setting unit 16c, to 
halve the number of second color difference signals Cb in the y direction, and 
the x-directional signal doubling unit 16b. 

In the above configuration, in the signal value setting unit 16c, an average of two values U 1 x 2y and U 1 x2y+1 (or 
55 v1 x2y and v1 x2y-i) ot two co,or difference signals Cr (or Cb) adjacent to each other in the y direction is calculated for 
each pair of color difference signals Cr (or Cb) adjacent to each other in the y direction, and the average is set as 
values U 1 x 2y and U 1 x 2y+1 (or V 1 x 2y and V 1 Xi2y +i) of two color difference signals Cr (or Cb). Thereafter, in the same 
manner as in the first color difference signal converting method, the number of color difference signals Cr (or Cb) in 
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the y direction is halved in the y-directional signal halving unit 16a, and the number of color difference signals Cr (or 
Cb) in the x direction is doubled in the x-directional signal doubling unit 1 6b. That is, values of converted color difference 
signals Cr' and Cb' are determined according to a signal conversion equation (2). 

v 2 2 x.y = v 2 ^ = (v\^ + v , >lt2y+1 y2 (2) 

io Here x=0,1,2,3,~ and y=0,1 ,2,3,-- are satisfied. 

For example, as shown in Figs. 8A to 8E, in cases where color difference signals Cr and Cb corresponding to 
luminance signals Y of one sub-frame composed of 8*4 pixels are input to the color difference signal converting unit 
16, values of 4:2:0 type converted color difference signals Cr' and Cb' are determined as follows. 

' S u 2 00 = u 2 ^ = (u\ 0 + uV,)/2. u 2 2 . 0 = u\ 0 = <uVo + u 1 1 ,y2, 



u 2 01 = u 2 , , = (U 1 ^ + 0\ 3 )/2, u 2 2 , = u 2 31 = (U 1 , + u\ 3 y2. 

20 

2S ^0.1 = v\i = ( v1 o.2 + V\*V2 * nd V 2 ^ = = (V 1 ^ + v\. 3 )/2 

Accordingly, because all 4:1:1 type color difference signals Cr and Cb are used to produce the 4:2:0 type converted 
color difference signals Cr' and Cb\ color information of the 4:1:1 type component picture signals can be faithfully 
maintained in the 4:2:0 type component picture signals. Therefore, an original picture indicated by the 4:1 :1 type com- 
30 ponent picture signals can be faithfully reproduced at a high quality by producing a reproduced picture from the 4:2:0 
type component picture signals. 

Also, because an average of two values U 1 x2y and U 1 x2y+1 of two color difference signals Cr (or Cb) placed at 
positions adjacent to each other is calculated and set as values U 2 2x y and U 2 2x+l y of two converted color difference 
signals Cr' (or Cb') adjacent to each other, even though a particular color difference signal Cr (or Cb), in which a noise 
35 is undesirably added, is input to the converting unit 16, an adverse influence of the noise on the converted color 
difference signals Cr' (or Cb 1 ) can be reduced to half. 

Also, because the calculation of the arithmetic average is only required to the converting unit 16, the arithmetic 
calculation is easy, so that the 4:2:0 type converted color difference signals Cr' (or Cb') can be easily obtained. 

Next, the third color difference signal converting method performed in the step S102 is described with reference 
40 to Figs. 8A to 8E. 

In the third color difference signal converting method, as shown in Fig. 9C, the color difference signal converting 
unit 16 comprises: 

the signal value setting unit 16c, the y-directional signal halving unit 16a, and 

an x-directional signal doubling unit 1 6d for adding a color difference signal Cr (or Cb) to a position between each 

45 pair of color difference signals Cr (or Cb) which are obtained in the y-directional signal halving unit 1 6b and are adjacent 
to each other in the X direction, setting a value of one added color difference signal Cr (or Cb) to an interpolated value 
of the values of the color difference signals Cr (or Cb) placed on both sides of the added color difference signal in the 
x direction for each added color difference signal to double the number of color difference signals in the x direction and 
outputting the color difference signals as the 4:2:0 type converted color difference signals Cr* (or Cb'). 

so in the above configuration, the number of first (or second) color difference signals Cr (or Cb) is halved in the halving 

unit 16a, Thereafter, in the doubling unit 16d, a first (or second) color difference signal Cr (or Cb) is added to a position 
between each pair of first (or second) color difference signals Cr (or Cb) adjacent to each other in the X direction, a 
value of one added color difference signal Cr (or Cb) to an interpolated value of the values of the color difference 
signals Cr (or Cb) placed on both sides of the added color difference signal in the x direction for each added color 

55 difference signal to double the number of color difference signals in the x direction, and the color difference signals 
are output as the 4:2:0 type converted color difference signals Cr* (or Cb'). That is, in the halving unit 1 6a, a resolution 
of the converted color difference signals Cr 1 and Cb' in the y direction is reduced to half that of the 4:1:1 type color, 
difference signals Cr and Cb in the same manner as in the second color difference signal converting method. Also, in 
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the doubling unit 16d, (or example, a particular converted color difference signal Cr 1 (or Cb') placed at each odd- 
numbered x co-ordinate value is added, a value U 2 2x+1 y (or V 2 2x+1 y ) of each particular converted color difference 
signal Cr 1 (or Cb') is set to an interpolated value of values U 2 2x. y and U 2 2(x+1)y (or \Z 2 2 xy and v2 2(x+i).y) of converted 
color difference signals Cr' (or Cb 1 ) placed on both sides of the particular converted color difference signal in the x 
5 direction, so that a resolution of the converted color difference signals Cr' and Cb' in the x direction is doubled. For 
example, values of converted color difference signals Cr' and Cb' are determined according to a signal conversion 
equation (3). 

U 2 atJf = (U 1 x ay + U 1 x .2 y+ iV2 
U2 2x + 1.y = (« u2 2x.y + ( 1 -«) u2 2(x + n.y) /2 

V 2 ^ y = (aV 2 ^ y + (1 -cOV^^.y/ 2 < 3 > 

Here x=0, 1,2,3,--. y=0,1 ,2,3,-- and 0<a<1 are satisfied. 

In this case, because any of values of rightmost converted color difference signals is not determined according to 
20 the interpolation for each sub-frame, the values are determined according to the extrapolation. For example, a value 
of one rightmost converted color difference signal is set to a value of a second rightmost converted color difference 
signal placed on the left side of the rightmost converted color difference signal for each row of each sub-frame. 

As an example shown in Figs. 8A to 8E, in cases where color difference signals Cr and Cb corresponding to 
luminance signals Y of one sub-frame composed of 8*4 pixels are input to the color difference signal converting unit 
25 16, when a constant value a is set to 0.5, values of 4:2:0 type converted color difference signals Cr' and Cb' are 
determined as follows. 

U Vo = ( U Vo + U1 0.1) /2 ' U2 2.0 = ( U \.0 + U \.1> /2 ' 

30 

U\ 0 = (<<) + U 2 2 0 )/2, U 2 3 o = U 2 2 . 0 , U 2 01 = (UV 2 + U 1 0 3 V2, 

35 < U V 2 + uV 3 )/2, U\, =: (U 2 0 l + U 2 21 )/2, U 2 3 , = U% v 

^0,0 = < v Vo + v1 o,i) /2 ' ^2.0 = < v Yo + V \.1 > /2 ' 
40 v\ 0 = (^0.0 + ^2.0^2- A* = ^2.0- v\i = ( v1 o.2 + 

^2.1 = < V V 2 + V \.3> /2 < = (^0.1 + ^2.1 V 2 - ^3.1 = V 2.1 

45 

Accordingly, even though values U 2 2x y and u2 2(x+i),y of particular converted color difference signals Cr' (or Cb') 
produced from values of color difference signals Cr (or Cb) are considerably different from each other, because a value 
between the values U 2 ^ and U 2 2(X4 .-, )<y is interpolated as a value U 2 2x+1 y of a converted color difference signal placed 
between the particular converted color difference signals, the change of the values of the three converted color differ- 
so ence signals Cr' (or Cb') is made smooth. Therefore, when a discrete cosine transform (DCT) is performed for the 4: 
2:0 type converted color difference signals to perform the compression based on MPEG1 or MPEG2 for the 4:2:0 type 
component picture signals, because color information of the converted color difference signals is concentrated in lower 
frequency portions, a compression efficiency can be improved. 

Next, the fourth color difference signal converting method performed in the step S102 is described with reference 
55 to Figs. 8Ato 8E. 

In the fourth color difference signal converting method, as shown in Fig. 9D, the color difference signal converting 
unit 16 comprises: 
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an average value calculating unit 1 6e tor calculating a first average of values of two first (or second) color difference 
signals Cr (or Cb) of co-ordinates (x,2y) and (x,2y+1 ) adjacent to each other in the y direction and a second average 
of values of two first (or second) color difference signals Cr (or Cb) of co-ordinates (x+1 .2y) and (x+1 .2y+1 ) adjacent 
to each other in the y direction for each group of first (or second) color difference signals of the co-ordinates (x, 
5 2y), (x.2y+1), (x+1 ,2y) and (x+1,2y+1); 

an interpolated value calculating unit I6f for calculating a first interpolated value obtained by weighting the first 
and second averages at a first weighting ratio and a second interpolated value obtained by weighting the first and 
second averages at a second weighting ratio for each pair of first and second averages; 

a signal value setting unit 16g for setting the first interpolated value calculated in the interpolated value calculating 
jo unit 161 as values of the first (cr second) color difference signals of the co-ordinates (x,2y) and (x,2y+1); 

the y -directional signal halving unit 16a; and 

an x-directional signal doubling unit 16h for adding a first (or second) color difference signal to a position between 
each pair of first (or second) color difference signals Cr (or Cb) which are obtained in the y-directional signal halving 
unit I6h and are adjacent to each other in the X direction, setting a value of one added first (or second) color 
is difference signal to the second interpolated value for each added first (or second) color difference signal to double 

the number ol first (or second) color difference signals in the x direction and outputting the first (or second) color 
difference signals as the 4:2 0 type first (or second) converted color difference signals Cr' (or Cb"). 

In the above configuration, in the average value calculating unit 16e, a first average of two values U 1 x2y and 

20 u1 x2y+i (° r v *x 2y and v1 x2yi) oi iwo color difference signals Cr (or Cb) adjacent to each other in the y direction and 
a second aveiage of two values U 1 x+1 ^ and U 1 X+1 ^ (or V 1 X+1 ^ and V 1 x+12y+ i) o f two co!or difference signals Cr 
(or Cb) adjacent to each other in the y direction are calculated. Thereafter in the interpolated value calculating unit 
1 6f , a first interpolated value and a second interpolated value are calculated from the first and second averages. There- 
after, in the signal value setting unit I6g, the first interpolated value is set as values of the color difference signals of 

25 the co-ordinates (x.2y) and (x,2y+1 ). Thereafter, the number of color difference signals in the y direction is halved in 
the halving unit 16a. Thereafter in the doubling unit 16b, the number of color difference signals in the x direction is 
doubled by adding a color difference signal to a position between each pair of color difference signals Cr (or Cb) 
adjacent to each other in the X direction and setting a value of one added color difference signal to the second inter- 
polated value for each added color difference signal, and the color difference signals Cr (or Cb) are output as converted 

30 color difference signals Cr' (or Cb'). That is, the first interpolated value is set as a value U^.y (or V 2 ^*) of each 
converted color difference signal Cr 1 (or Cb') in the setting unit I6g, a resolution of the color difference signals Cr and 
Cb in the y direction is reduced to half that of the 4:1 : 1 type color difference signals Cr and Cb in the same manner as 
in the second color difference signal converting method, and the second interpolated value is set as a value U 2 2x+i, y 
(or ^2x^1 y ) of eacn converted color difference signal Cr' (or Cb') in the doubling unit 16d. For example, values of 

35 converted color difference signals Cr' and Cb' are determined according to a signal conversion equation (4). 

u2 2x.y = ( 3A + Q V 4 
U 2 2x+ly = (A + 3B)/4 

BMU\ +I2y + U\ +1 ^2 
V^.y = <3C + D)/4 

V 2 2x + l.y = ( C + 3D » /4 
so C = (V 1 x2y + V 1 x2y+l V2 

D = (vViay + v1 x*ijy*iV2 

Here x=0, 1,2,3,-- and y=0,1 ,2,3,-- are satisfied. 
55 In this case, any of values of rightmost converted color difference signals is not determined according to the inter- 

polation for each sub-frame. Also, any of values of second rightmost converted color difference signals placed on the 
left side of the rightmost converted color difference signals is not determined according to the interpolation for each, 
sub-frame. Therefore, the values of rightmost converted cotor difference signals and the values of second rightmost 
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converted color difference signals are determined according to the extrapolation. For example, a value of one rightmost 
converted color difference signal and a value of one second rightmost converted color difference signal are set to a 
value of a third rightmost converted color difference signal placed on the left side of the second rightmost converted 
color difference signal for each row of each sub-frame. 
s As an example shown in Figs. 8A to 8E, in cases where color difference signals Cr and Cb corresponding to 

luminance signals Y of one sub-frame composed of 8*4 pixels are input to the color difference signal converting unit 
16, values of 4:2:0 type converted color difference signals Cr' and Cb' are determined as follows. 

10 u2 o.o = < u Vo + ul o.i)* 3/s + ( u Yo + u \.in /8 ' 

u2 i.o = ( u Vo + u Vin /8 + ( u Vo + u \,i w 

U 2 01 = (U 1 ^ + U 1 03 r3/8 + (U 1 , 2 + U\ 3 n/8, and 

2 11 1 1 1 

u 1.1= (U 0.2 + u o. 3 r i/8 + ( U 1.2 + u 

20 

Accordingly, even though values of color difference signals input to the converting unit 1 6 are considerably different 
from each other, because values of all converted color difference signals are determined according to the linear inter- 
polation and are output from the converting unit 16, the change of the values of the converted color difference signals 
can be made smoother that in the third color difference signal converting method. Therefore, when a discrete cosine 

25 transform (DCT) is performed for the 4:2:0 type converted color difference signals, a compression efficiency can be 
improved more than that in the third color difference signal converting method. 

Next, three actual examples (x=0,1 and y=0,1 in the equations (1), (2), (3) and (4)) of the color difference signal 
conversion are described with reference to Figs. 11 and 13. 

In a first actual example, in cases where 4:1:1 type color difference signals Cr (or Cb), of which values are'shown 

30 in Fig. 1 1 A, are input to the color difference signal converting unit 1 6, when the color difference signals are converted 
according to the first color difference signal converting method, 4:2:0 type converted color difference signals Cr* (or 
Cb'), of which values are shown in Fig. 11 B, are output from the converting unit 16. Also, when the color difference 
signals are converted according to the second color difference signal converting method, 4:2:0 type converted color 
difference signals Cr' (or Cb'), of which values are shown in Fig. 11C, are output from the converting unit 16. Also, 

35 when the color difference signals are converted according to the third color difference signal converting method : 4:2: 
0 type converted color difference signals Cr' (or Cb'), of which values are shown in Fig. 11 D, are output from the 
converting unit 16. Also, when the color difference signals are converted according to the fourth color difference signal 
converting method, 4:2:0 type converted color difference signals Cr' (or Cb'), of which values are shown in Fig. 11 E, 
are output from the converting unit 16. 

40 Also, in a second actual example, in cases where 4:1:1 type color difference signals Cr (or Cb), of which values 

are shown in Fig. 12A, are input to the color difference signal converting unit 16, 4:2:0 type converted color difference 
signals Cr' (or Cb'), of which values are shown in Fig. 12B, are output from the converting unit 16 when the color 
difference signals are converted according to the first color difference signal converting method, 4:2:0 type converted 
color difference signals Cr' (or Cb'), of which values are shown in Fig. 12C, are output from the converting unit 16 when 

45 the color difference signals are converted according to the second color difference signal converting method, 4:2:0 
type converted color difference signals Cr' (or Cb'), of which values are shown in Fig. 1 2D, are output from the converting 
unit 16 when the color difference signals are converted according to the third color difference signal converting method, 
and 4:2:0 type converted color difference signals Cr' (or Cb'), of which values are shown in Fig. 12E, are output from 
the converting unit 16 when the color difference signals are converted according to the fourth color difference signal 

50 converting method. 

Also, in a third actual example, in cases where 4:1:1 type color difference signals Cr (or Cb), of which values are 
shown in Fig. 13A, are input to the color difference signal converting unit 16, 4:2:0 type converted color difference 
signals Cr* (or Cb'), of which values are shown in Fig. 13B, are output from the converting unit 16 when the color 
difference signals are converted according to the first color difference signal converting method, 4:2:0 type converted 
ss color difference signals Cr' (orCb'), of which values are shown in Fig. 13C, are output from the converting unit 16 when 
the color difference signals are converted according to the second color difference signal converting method, 4:2:0 
type converted color difference signals Cr' (or Cb'), of which values are shown in Fig. 1 3D, are output from the converting 
unit 1 6 when the color difference signals are converted according to the third color difference signal converting method, 



28 



EP 0 862 339 A2 



and 4:2:0 type converted color difference signals Cr* (or Cb'), of which values are shown in Fig. 13E, are output from 
the converting unit 16 when the color difference signals are converted according to the fourth color difference signal 
converting method. 

Here, in cases where a value calculated according to one of the signal conversion equations is not an integral 
5 number, the value is rounded ofl to an integral number. Also, in cases where a value of a converted color difference 
signal is not determined because the value is determined by using a value of a color difference signal not indicated in 
Fig. 1 1 A, Fig. 1 2A or Fig. 1 3A, the value is indicated by a sign "-" in Fig. 1 1 E, Fig. 1 2E or Fig. 1 3E. 

Features of conversion results (or converted color difference signals Cr' (or Cb')) in the actual examples are de- 
scribed. 

?o in the first and second color difference signal converting methods, values U 2 2x. y and U 2 2x+ i, y (or V^.y a nd 

\/2 2x+1 y ) of converted color difference signals Cr' (or Cb') adjacent to each other in the x direction are the same as 
each other in all actual examples. 

In the first color difference signal converting method, because odd-numbered color difference signals placed at 
odd-numbered y co-ordinate values (or even-numbered lines) are not used to determine converted color difference 

?5 signals, values of the odd-numbered color difference signals do not influence on values of converted color difference 
signals. For example, a set of values of color difference signals in the first line shown in Fig. 11 A, a set of values of 
color difference signals in the first line shown in Fig. 12A and a set of values of color difference signals in the first line 
shown in Fig. 13A are the same as each other. In this case, though a set of values of color difference signals in the 
second line shown in Fig. 11 A, a set of values of color difference signals in the second line shown in Fig. 12A and a 

20 set of values of color difference signals in the second line shown in Fig. 13A are different from each other, a set of 
values of converted color difference signals placed in the first line shown in Fig. 1 1 B, a set of values of converted color 
difference signals placed in the first line shown in Fig. 12B and a set of values of converted color difference signals 
placed in the first line shown in Fig. 1 3B are the same as each other. 

In the third color difference signal converting method, a first average of two values of two color difference signals 

25 placed at co-ordinates (x,2y) and (x,2y+1) adjacent to each other in the y direction is set as a value of a converted 
color difference signal placed at co-ordinates (2x,y), a second average of two values of two color difference signals 
placed at co-ordinates (x+1 ,2y) and (x+1 ,2y+1 ) adjacent to each other in the y direction is set as a value of a converted 
color difference signal placed at co-ordinates (2x+2,y), and a value between the first and second averages is interpo- 
lated as a value of a converted color difference signal placed at co-ordinates (2x+1,y). In these actual examples, an 

30 average of the first and second averages is set as a value of a converted color difference signal at coordinates (2x+1 ,y).. 

In the fourth color difference signal converting method, though the first and second averages are calculated in the 
same manner as in the third color difference signal converting method, any of the first and second averages is not 
used as a value of a converted color difference signal, but two interpolated values between the first and second averages 
are used as values of two converted color difference signals adjacent to each other in the x direction. Therefore, even 

35 though values of the color difference signals input to the converting unit 16 vary widely, because any of the values or 
any of the first and second averages is not used as a value of a converted color difference signal, the variation of values 
of converted color difference signals output from the converting unit 16 can be made small. Also, even though a noise 
is added to a color difference signal, the influence of the noise on the converted color difference signals can be con- 
siderably reduced. 

40 Accordingly, as is described above, in cases where the picture signal converting apparatus 1 1 and one of the color 

difference signal converting methods are used, the 4:1 : 1 type component picture signals can be directly converted into 
the 4:2:0 type component picture signals. 

(Second Embodiment) 

45 

In general, luminance information of a natural picture and color information of the natural picture correlate to each 
other. Therefore, there is high probability that luminance degrees at pixels vary as colors at the pixels vary. In this 
embodiment, to consider this special feature of the natural picture, values of luminance signals Y are referred to directly 
convert the 4:1:1 type component picture signals into the 4:2:0 type component picture signals. 
so Fig. 14 is a block diagram of a picture signal converting apparatus according to a second embodiment of the 

present invention. 

As shown in Fig. 14, a picture signal converting apparatus 21 comprises 

the input unit 12, the Y frame memory 13, the input Cr frame memory 14, the input Cb frame memory 15, 
ss a referential luminance signal extracting unit 22 for extracting a plurality of luminance signals from the Y frame 

memory 13 as a plurality of referential luminance signals, 

a color difference signal converting unit 23 for converting the first color difference signals Cr and the second color, 
difference signals Cb into first converted color difference signals Cr' and 4:2:0 type second converted color differ- 
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ence signals Cb* for each frame while referring the referential luminance signals. 

the output Cr frame memory 17, the output Cb frame memory 18 and the output unit 19. 

tn the above configuration, an operation performed in the picture signal converting apparatus 21 is described in 
5 brief with reference to Fig. 15. 

As shown in Fig. 15, after the step S101 is performed, a step S201 is performed. In this step, the color difference 
signals Cr and Cb stored in the input Cr frame memory 14 and the input Cb frame memory 15 are input to the color 
difference signal converting unit 23 and are converted into a plurality of 4:2:0 type color difference signals Cr' and Cb' 
while referring a plurality of referential luminance signals Y extracted by the referential luminance signal extracting unit 
10 22 according to a fifth color difference signal converting method or a sixth first color difference signal converting method. 
Thereafter the first converted color difference signals Cr' are stored in the output Cr frame memory 1 7, and the second 
converted color difference signals Cb' are stored in the output Cb frame memory 18. Thereafter, the steps S103 and 
S104 are performed in the same manner as in the converting unit 11. 

The f if tn color difference signal converting method performed in the step S201 according to the second embodiment 
is is described in detai! with reference to Figs. 8A to 8E. 

In the tilth color difference signal converting method, as shown in Fig. 16A, the color difference signal converting 
unit 23 comprises 

an average value calculating unit 23a for calculating an average of values of two color difference signals Cr (or 
20 Cb) of co-ordinates (x.2y) and (x,2y+1) adjacent to each other in the y direction for each pair of color difference 

signals. 

a weighting factor calculating unit 23b for obtaining the referential luminance signals extracted by the referential 
luminance signal extracting unit 22 as first referential luminance signals on condition that the first referential lumi- 
nance signals correspond to the color difference signals of co-ordinates (x,2y) and (x+1,2y), calculating a first 

25 weighting factor B/2(A+B) and a second weighting factor A/2(A+B) from values of the first referential luminance 

signals, obtaining the referential luminance signals extracted by the referential luminance signal extracting unit 23 
as second referential luminance signals on condition that the second referential luminance signals correspond to 
the color difference signals of co-ordinates (x,2y+1) and (x+1,2y+1) and calculating a third weighting factor D/2 
(C+D) and a fourth weighting factor C/2(C+D) from values of the first referential luminance signals; 

30 an interpolated value calculating unit 23c for calculating a first multiplied value by multiplying the value U 1 x 2y (or 

V 1 x2y ) of the color difference signal of the co-ordinates (x : 2y) by the first weighting factor, calculating a second 
multiplied value by multiplying the value U 1 x+12y (or V 1 x+U2y ) of the color difference signal of the co-ordinates 
(x+1,2y) by the second weighting factor, calculating a third multiplied value by multiplying the value UV^+i ( or 
V 1 x 2y +1 ) of the color difference signal of the co-ordinates (x,2y+1 ) by the third we ighting factor, calculating a fourth 

35 multiplied value by multiplying the value U 1 x+1 <2y+1 (or V 1 x+1 i2y+1 ) of the color difference signal of the co-ordinates 

(x+l,2y+1) by the fourth weighting factor and calculating an interpolated value from the first, second, third and 
fourth multiplied values; 

a signal value setting unit 23d for setting each average as values of the color difference signals of the co-ordinates 
(x,2y) and (x,2y+1); 

40 the y-directional signal halving unit 16a; and 

an x-dtrectional signal doubling unit 23e for adding a color difference signal to a position between each pair of 
color difference signals adjacent to each other in an X direction, setting a value of one added color difference signal 
to the interpolated value for each added color difference signal to double the number of color difference signals in 
the x direction and outputting the color difference signals as the 4:2:0 type converted color difference signals Cr* 

45 (or Cb'). 

tn the above configuration, an average of two values lP x>2 y and U 1 x2y+1 (or V 1 ^ and v1 x.2y+i) of two color 
difference signals Cr (or Cb) adjacent to each other in the y direction is calculated in the average value calculating unit 
23a and is set as a value U 2 ^ (or V 2 2x , y ) of a 4:2:0 type converted color difference signal Cr' (or Cb') in the signal 

50 value setting unit 23d and the y-directional signal halving unit 1 6a to reduce a resolution of the converted color difference 
signals Cr' and Cb* in the y direction to half that of the 4:1:1 type color difference signals Cr and Cb. Also, a value 
u2 2x + i y (° r y/2 2x^, y ) of a converted color difference signals Cr' (or Cb') adjacent to the converted color difference 
signal Cr* (or Cb') having the value U 2 ^ y (or V 2 2x . y ) in tne x direction is calculated in the interpolated value calculating 
unit 23c and the x-directional signal doubling unit 23e by linearly interpolating weighted values obtained by weighting 

ss values of four color difference signals placed at co-ordinates (x,2y), (x+1 ,2y), (x,2y+1 ) and (x+1 ,2y+1 ) with the weighting 
factors calculated by the weighting factor calculating unit 23b. The weighting factors are calculated according to a first 
group of referential luminance signals placed at coordinates (4x : 2y), (4x+1 ,2y), (4x+2,2y) and (4x+3,2y) corresponding 
to the color difference signal at the co-ordinates (x,2y), a second group of referential luminance signals placed at co- 
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ordinates (4 (x+1).2y), (4(x+1)+1,2y). (4(x+1)+2,2y) and <4(x+1)+3,2y) corresponding to the color difference signal at 
the co-ordinat es (x+1 ,2y). a third group of referential luminance signals placed at co-ordinates (4x,2y+1 ). (4x+1 ,2y+1 ), 
(4x+2,2y+1) and (4x+3.2y+1) corresponding to the color difference signal at the co-ordinates (x,2y+1) and a fourth 
group of referential luminance signals placed at coordinates (4(x+1).2y+1), (4 (x+1j+1 ,2y+1), (4(x+1)+2,2y+1) and (4 
(x+1)+3 2y+1) corresponding to the color difference signal at the co-ordinates (x+1,2y+1). Therefore, a resolution of 
the converted color difference signals Cr' and Cb' is doubled in the x direction. That is, values of converted color 
difference signals Cr' and Cb' are determined according to a signal conversion equation (5). 

U 2 a«.y = (U 1 x-2y + U WlV 2 
U 2 2x+1 . y = U 1 ^ * B/2(A + B) + U 1 x+1 ^ * A/2(A + B) + U 1 ^, * D/2(C + D) + U 1 x+l2y+l * C/2(C + D) 

V 2 a £ .y = ( vl x.2y +Vl x.2y + 1) /2 

^ex+i.y = Vl x-2y * B/2 < A+B > + v1 x + v2y * A/2(A + B) + V 1 x2y+1 * D/2(C + D) + V x+1 ^ * C/2(C + D) 

2 

A - K Y 4x.2y + Y 4x+1.2yi " ( Y 4x+2,2y + Y 4x+3.2y)J 

2 

B = {( Y 4 (x + 1).2y + Y 4(x+1>+1-2y^ " ^ Y 4x + 2.2y + Y 4x+3.2yM 

2 

C = K Y 4x,2y*1 + Y 4xM.2y+l) " ( Y 4x+2.2y + 1 + Y 4x+3.2y4l M 

2 

D = {( Y 4(x+l).2y+1 + Y 4(x+1>+1.2y+1) " ( Y 4x+2.2y+1 + Y 4x+3.2y+1 )} 



(5) 



Here x=0,1 ,2,3,-- and y=0,1,2,3,-- are satisfied. 

In the equation (5), as values of particular luminance signals Y 4x+22y and Y 4x+3 ^ (or Y 4x+2 2y +1 and Y 4x+32y+1 ) 
corresponding to a particular converted color difference signal U2 2x+1 y or V2 2x+1 . y placed at an interpolation position 
(2x+l.y) approaches values of luminance signals Y 4(x+1)2y and Y 4(x+1>+1 2y (or Y 4(x+1)2y+1 and Y 4(x+1)+12y+1r placed 

so on the right side of the particular luminance signals, the influence of a particular color difference signal U 1 x+12y or 
v1 x + i (° r u \ + i 2 y+ i or v1 x + i 2y + i) corresponding to the luminance signals Y 4(x+1)<2y and Y 4(x ^ 1)+1 ^ (or Y 4(x+V)2y+1 
and + Y 4( „ , o n j on value of the particular converted color difference signal is increased. In contrast, as values of 
particular luminance signals Y 4x+2 2y and Y^ay (or and Y 4x+3 ^) corresponding to a particular converted 

color difference signal U 2 2x+1 or V2 2x+n y placed at an interpolation position (2x+1 ,y) approaches values of luminance 

35 signals Y 4x 2y and Y 4x+1 ^ (or Y 4x ^ and Y 4x+1 ^) placed on the left side of the particular luminance signals, the 
influence of a particular color difference signal LM x ^ or V* x 2y (or U 1 x 2y+1 or V 1 x2y+1 ) corresponding to the luminance 
signals Y 4x ^ and Y 4x+1 ^ (or Y 4x 2y +1 and Y 4x+1 >2y+1 ) on a value of the particular converted color difference signal is 
increased For example, when the values of the particular luminance signals approaches the values of the luminance 
signals Y 4(x+1)2y and Y 4(x+1)+1 . 2y , B<A is satisfied, so that A/2(A+B) > B/2(A+B) is obtained. Therefore, the influence 

40 of the color difference signal IP x+1 t2y on the value of particular converted color difference signal U 2 2x +1 y is larger than 
the influence of the color difference signal U 1 x 2i on the value of particular converted color difference signal U 2 ^ y . 
Here, the value A corresponds to a distance between a group of values of the luminance signals Y 4x ^ and Y 4x+1 2y 
and a group of values of the luminance signals Y 4x+2 ^ and Y 4x+3 2yi and the value B corresponds to a distance between 
a group of values of the luminance signals Y 4(x+1) 2y and Y 4(x+1)+1 ^ and a group of values of the luminance signals 

45 Y 4x+2 2y and Y 4x+3 2y 

Therefore, the correlation between luminance information and color information in a natural picture can be con- 
sidered. 

In the equation (5), because any of values of rightmost converted color difference signals is not determined ac- 
cording to the interpolation for each sub-frame, the values are determined according to the extrapolation. For example, 
so a value of one rightmost converted color difference signal is set to a value of a second rightmost converted color 
difference signal placed on the left side of the rightmost converted color difference signal for each row of each sub-frame. 

As an example shown in Figs. 8A to 8E, in cases where color difference signals Cr and Cb corresponding to 
luminance signals Y of one sub-frame composed of 8*4 pixels are input to the color difference signal converting unit 
23, values of 4:2:0 type converted color difference signals Cr' and Cb' are determined as follows. 



U 2 0 .o = ( u1 o.o + u1 o.i) /2 
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u2 i.o = U 1 0 .o* B o /2 ( A o +B o) + U\. 0 *A 0 /2(A 0+ B 0 ) + U 1 0 *D 0 /2(C 0+ D 0 ) + u;/C 0 /2(C 0+ D 0 ) 

u2 2.o-( u1 i.o + u1 i.i) /2 
=( u1 o.2 + u1 o. 3 ) /2 

U 2 ..! = U^B^^+B,) + U 1 , 2 *A 1 /2(A 1 +B 1 ) + U 1 Q 3*0^2(0^) + u\ 3*0/2(0^) 

U 2 2.i=( u1 ii» + u1 i.3V2 
' v2 o^> = ( v Vo + v1 o.iV2 
^1.0 = V 1 0 O *B o /2(A o+ B 0 ) + V 1 , 0 *A 0 /2(A 0+ B 0 ) + V 1 0<1 *D 0 /2(C 0 +D 0 ) + v\ /C 0 /2(C 0+ D 0 ) 

V 2 2 J o = ( v1 i,o + v ViV2 
v2 o.i=( v1 o.2 + v1 o. 3 ) /2 
^1.1 =V 1 02 *B 1 /2(A 1+ B 1 )+V 1 12 *A 1 /2 ( A i +B i) + v1 o.3* D i /2 ( c i +D i) + V \.3* c i /2 ( C 1 +D i> 

^2.1 =(V 1 1J8 + V 1 1i3 V2 

A 0 = {( Y 0.0 +Y 1. 0 ) - ( Y 2.0 +Y 3.0» 2 ' B 0 ^ « Y 4.0 +Y 5.0) " ( Y 2.0 +Y 3.0» 2 

C 0 = {( Y 0.1 +Y 1.l) * < Y 2.1 +Y 3,l)} 2 . D 0 = « Y 4.1 +Y 5.l) " ( Y 2.1 +Y 3.1» 2 

40 9 2 

A, = «Y oa+ Y 1<2 ) - (Y 2 2+ Y 32 )}^ B, = {(Y 4 2+ Y 5 2 ) - (Y 22+ Y 32 )} 

C 1 = {(Y 0t3+ Y 1 3 ) - (Y 2 3+ Y 33 )} 2 , D, = {(Y 4 3+ Y 5 3 ) - (Y 23 +Y 33 )} 2 

45 

Accordingly, because the luminance signals Y are referred in the color difference signal converting unit 23 when 
the 4:1:1 type component picture signals are directly converted into the 4:2:0 type component picture signals, the 
correlation between color information and luminance information generally existing in a natural picture as a specific 
feature can be included in the converted color difference signals, and an image of the natural picture can be reproduced 
so at high definition. 

Next, the sixth color difference signal converting method performed in the step S201 according to the second 
embodiment is described in detail with reference to Fig. 8. 

in the sixth color difference signal converting method, as shown in Fig. 16B, the color difference signal converting 
unit 23 comprises: 

55 

a weighting factor calculating unit 23f for obtaining the referential luminance signals extracted by the referential 
luminance signal extracting unit 22 as first referential luminance signals on condition that the first referential lumi- 
nance signals correspond to the color difference signals Cr (or Cb) of co-ordinates (x,2y) and (x+1 ,2y), calculating 
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a first weighting factor B/2(A+B), a second weighting factor A/2{A+B), a third weighting factor D/2(C+D) and a 
fourth weighting factor C/2(C+D) from values of the first referential luminance signals, obtaining the referential 
luminance signals extracted by the referential luminance signal extracting unit 22 as second referential luminance 
signals on condition that the second referential luminance signals correspond to the color difference signals Cr (or 
5 Cb) of co-ordinates (x,2y+1 ) and (x+1 ,2y+1 ) and calculating a fifth weighting factor F/2 (F+E) and a sixth weighting 

factor E/2(E+F), a seventh weighting factor H/2(H+G) and an eighth weighting factor G/2(H+G) from values of the 
second referential luminance signals; 

an interpolated value calculating unit 23g for calculating a first multiplied value by multiplying the value of the color 
difference signal Cr (or Cb) of the co-ordinates (x,2y) by the first weighting factor, calculating a second multiplied 

io value by multiplying the value of the color difference signal of the co-ordinates (x+1,2y) by the second weighting 

factor, calculating a third multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x,2y+1) by the fifth weighting factor, calculating a fourth multiplied value by multiplying the value of the color 
difference signal of the co-ordinates (x+1,2y+1) by the sixth weighting factor, calculating a first interpolated value 
from the first, second, third and fourth multiplied values, calculating a fifth multiplied value by multiplying the value 

is of the color difference signal of the co-ordinates (x,2y) by the third weighting factor, calculating a sixth multiplied 

value by multiplying the value of the color difference signal of the co-ordinates (x+1,2y) by the fourth weighting 
factor, calculating a seventh multiplied value by multiplying the value ol the color difference signal of the co-ordi- 
nates (x,2y+l) by the seventh weighting factor, calculating an eighth multiplied value by multiplying the value of 
the color difference signal of the co-ordinates (x+1,2y+l) by the eighth weighting factor, calculating a second 

20 interpolated value from the fifth, sixth, seventh and eighth multiplied values; 

a signal value setting unit 23h for setting the first interpolated value calculated in the interpolated value calculating 
unit 23g as values of the color difference signals Cr (or Cb) of the co-ordinates (x,2y) and (x,2y+1 ); 
the y-directional signal halving unit 16a for removing color difference signals Cr (or Cb) on every other row from 
the color difference signals Cr (or Cb), of which the values are set in the signal value setting unit 23h, to halve the 

25 number ol color difference signals Cr (or Cb) in the y direction; and 

an x-directional signal doubling unit 23i for adding a color difference signal to a position between each pair of the 
color difference signals Cr (or Cb) adjacent to each other in the X direction, setting a value of a color difference 
signal of one added color difference signal to the second interpolated value for each added color difference signal 
to double the number of color difference signals obtained in the y-directional signal halving unit 23h in the x direction 

30 and outputting the color difference signals as the 4:2:0 type converted color difference signals Cr' (or Cb'). 

In the above configuration, a value U 2 2x, y (or V^.y) of a converted color difference signal Cr* (or Cb*) is set in the 
signal value setting unit 23h to a first interpolated value calculated from a value LP^y (or V 1 x2y ) of a color difference 
signal Cr (or Cb) placed at first coordinates (x,2y), a value U 1 x+12y (or V 1 x+12 ) of a color difference signal of second 

35 co-ordinates (x+1 ,2y) adjacent to the first co-ordinates in the x direction, a value U 1 x >2y+1 (or V 1 x 2y+ i) of a color differ- 
ence signal of third co-ordinates (x,2y+1 ) adjacent to the first co-ordinates in the y direction and a value U 1 x+12y+ i ( or 
V 1 x+1 2y +1 ) of a color difference signal of fourth co-ordinates (x+1 ,2y+1 ) adjacent to the second co-ordinates in the y 
direction while multiplying each value of the color difference signal by a weighting factor. The weighting factors respec- 
tively indicating an influence of one color difference signal on the converted cobr difference signal is calculated in the 

40 weighting factor calculating unit 23f by referring the referential luminance signals Y. Therefore, a resolution of the 
converted color difference signals Cr' and Cb' in the y direction is reduced to half that of the color difference signals 
Cr and Cb. Also, a value U 2 2x+1 y (or V^+i.y) 0 * a converted color difference signal adjacent to the converted color 
difference signal of the value U 2 2xy (or V^xy) in tne x direction is calculated in the x-directional signal doubling unit 
23i from the values x2yi U* x+1 ^ U 1 x<2y+1 , U\ +1 . 2y+1 (or V x2y , V x+1 >2y , V x 2y+1 , V x+1 . 2y+1 ) of the color difference 

45 signals Cr (or Cb) while multiplying each value of the color difference signal by a weighting factor. Therefore, a resolution 
of the converted color difference signals Cr* and Cb' in the x direction is doubled. For example, values of converted 
color difference signals Cr' and Cb' are determined according to a signal conversion equation (6). 

so = Ul x-2y * B/2(A+B> + U 1 ^ * A/2(A+B) + 

"Wi * F/2 < E+F > + u1 ~i**i * E/2 < E+F) 
= Ul x.2y * D/2(C+D) + U 1 x+1 ^ * C/2(C+D) + 
55 U\ 2y+1 * HV2(G+H) + U 1 X+1 ^ * G/2(G+H) 

V'ax.y = v \.2y * B/2(A+B) + v 1 x+1 ^ * A/2(A+B) ♦ 
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v'xay + i * F/2(E+F) + v 1 ^^, * E/2(E + F) 
v2 2x + i.y = v \. 2y * D/2(C + D) + v 1 x+1 2y * C/2(C + D) + 
v1 x.2y + i * H/2(G + H) + v 1 x+12y+1 -G/2(G + H) 

2 

A = K Y 4x.2y + Y 4x+1.2y + Y 4x+2.2y + Y 4x+3.2y) " 2 ( Y 4x.2y + Y 4x+1.2y^ 

2 

B = U Y 4(x+1).2y + Y 4(x+1)+1.2y + Y 4(x+1)+2.2y + Y 4(x+1 )+3.2y) " 2 < Y 4x.2y + Y 4x+1,2y^ 

2 

C = K Y 4x.2y + Y 4x+1,2y + Y 4x+2.2y + Y 4x+3.2y) " 2 ( Y 4x+2.2y + Y 4x+3.2y)} 

2 

D ~ t( Y 4(x+1).2y + Y 4(x+1)+1.2y + Y 4(x+1)+2.2y + Y 4(x+1)+3.2y) ~ 2 ( Y 4x+2.2y + Y 4x+3.2y" 

2 

E = {( Y 4x.2y+1 + Y 4x+1.2y+1 ~*~ Y 4x+2.2y+1 + Y 4x+3.2y+1 ) ' 2 ( Y 4x.2y+1 + Y 4x+1.2y+1 

^ - {( Y 4(x+1),2y+1 + Y 4(x+1)+1,2y+1 + Y 4(x-t-1)+2,2y+1 + Y 4(x+1 )+3.2y+1 ) " 2 ( Y 4x,2y+1 + Y 4x+1,2y+1 ^ 

20 2 
G = K Y 4x.2y+1 + Y 4x+1.2y+1 + Y 4x+2.2y+1 + Y 4x+3,2y+1 ) " 2 ( Y 4x+2.2y+1 + Y 4x+3.2y+1 W 
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^ - {( Y 4(x+1),2y+1 + Y 4(x+1)+1.2y+l + Y 4(x+1 )+2.2y+1 + Y 4(x+1)+3.2y+1 ) " 2 ( Y 4x+2.2y+1 + Y 4x+3.2y+1 W ^ 



Here x=0 : l ,2,3,-- and y=0,1 ,2,3,-- are satisfied. In the equation (6), it is applicable that the square root of each weighting 
factor A to F be used as a weighting factor. 

In this case, any of values of rightmost converted color difference signals is not determined according to the inter- 
polation for each sub-frame. Also, any of values of second rightmost converted color difference signals placed on the 
left side of the rightmost converted color difference signals is not determined according to the interpolation for each 
30 sub-frame. Therefore, the values of rightmost converted color difference signals and the values of second rightmost 
converted color difference signals are determined according to the extrapolation. For example, a value of one rightmost 
converted color difference signal and a value of one second rightmost converted color difference signal are set to a 
value of a third rightmost converted color difference signal placed on the left side of the second rightmost converted 
color difference signal for each row of each sub-frame. 
35 As an example shown in Figs. 8 A to 8E, in cases where color difference signals Cr and Cb corresponding to 

luminance signals Y of one sub-frame composed of 8*4 pixels are input to the color difference signal converting unit 
23, values of 4:2:0 type converted color difference signals Cr' and Cb' are determined as follows. 

40 U 2 0 0 = U 1 0 0 *B 0 /2(A 0+ B 0 ) + U\ 0 -A 0 /2(A 0+ B 0 ) + A *F 0 /2(E Q+ F 0 ) + u\ /E Q /2(E 0+ F 0 ) 

u2 i.o = u V D o /2 ( C o +D o> + u Vo* C o /2 ( c o +D o) + UV/H 0 /2(G 0+ H 0 ) + u\ /G 0 /2(G 0 +H 0 ) 

v\ 0 = V 1 00 *B 0 /2(A 0+ B 0 ) + V\ 0 *A 0 /2(A 0+ B 0 ) + v\ ,*F Q /2(£ 0+ F Q ) + v\ A *E 0 /2{E 0 +*= 0 ) 
V 2 , Q = vVo*D 0 /2 ( C 0 +D o) +Vi.o* C 0 /2 ( C o +D o) + V 1 0 /H 0 /2(G 0+ H 0 ) + v\ /G 0 /2(G 0+ H Q ) 

A o = « Y o.o + Y i.o + Y 2.o + Y 3.o) - 2 < Y o.o + Y i.o)} 2 
B 0 = {(Y 4 0 + Y 5 0 + Y 6 0 + Y 7 0 ) - 2(Y 0 0 + Y 1 0 )} 2 
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C 0 = {( Y 0.0 + Y 1.0 + Y 2.0 + Y 3.0> " 2 ( Y 2.0 + Y 3.0)l 2 

Y 5.0 + Y 6.0 + Y 7.o' - 2 ( Y 2.0 + Y 3.0» 
E 0 = « Y 0.1 + Y 1.1 + Y 2.1 + Y 3.l) • 2( Y o., + Y i.i» 2 
P 0 = « Y 4.1 + Y 5.1 + Y 6.1 + Y 7.1> - 2( Y 0.1 + Y 1.1» 2 
G 0 = « Y 0.1 + Y 1.1 + Y 2.1 + Y 3.1> " 2^2.1 + Y 3.1» 2 

H 0 = {( Y 4.t + Y 5.i + Y 6.i +Y 7.,) - 2(Y 2<1 + Y 31 )} 2 
U 2 0 .1 = U^'B^A^B,) + U\ 2 *A,/2(A 1+ B 1 ) + U 1 03 *F 1 /2(E 1+ F 1 ) + U 1 , 3 'E,/2(E,+F A ) 
U 2 ,.i = u'o^D^^+D^ + U 1 , 2*0^2(0, + D 1 ) + U 1 0 3 *H,/2(G 1+ H 1 ) + U 1 1 . 3 *G 1 /2(G 1+ H 1 ) 
^0.1 = v1 0.2* B i /2 ( A i +B i> + V 1 , 2*^/2(^+8,) + V 1 03 *F,/2(E 1+ F 1 ) + V 1 , 3 'E,/2(E,^ A ) 

1 .2 + Y 2.2 + Y 3.2^ 
K Y 4.2 + Y S.2 + Y 6.2 + Y 7.2) 

-2( Y o. 2 + Y i.2)r 

« Y 0.2 + Y 1,2 + Y 2.2 + Y 3. 2 ) " 2( Y 2.2 + Y 3.2» 2 
{( Y 4.2 + Y 5.2 + Y 6.2 + Y 7.2) - 2 < Y 2.2 + Y 3.2» 
K Y 0.3 + Y 1.3 + Y 2.3 + Y 3. 3 ) " 2( Y o. 3 + Y ,.3» 2 
« Y 4.3 + Y S.3 + Y 6.3 + Y 7.3^ 

<( Y 0.3 + Y 1 .3 + Y 2.3 + Y 3. 3 ) " 2( Y 2.3 + Y 3.3» 2 

Y 5.3 + Y 6.3 + Y 7.3^ -2< Y 2.3 +Y 3.3» 

Accordingly, because each converted color difference signal is determined according to the interpolation based 
on four color difference signals and are output from the converting unit 23, even though values of color difference 
signals input to the converting unit 23 are considerably different from each other, the change of the values of the 
converted color difference signals can be made smoother that in the fifth color difference signal converting method. 
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Therefore, when a discrete cosine transform (DCT) is performed for the 4:2:0 type converted color difference signals, 
a compression efficiency can be improved more than that in the fifth color difference signal converting method. 

Also, because the luminance signals Y are referred in the color difference signal converting unit 23 when the 4:1 : 
1 type component picture signals are directly converted into the 4:2:0 type component picture signals, the correlation 
5 between color information and luminance information generally existing in a natural picture as a specific feature can 
be included in the converted color difference signals, and an image of the natural picture can be faithfully reproduced 
at high definition. 

Next, actual examples of the color difference signal conversion according to the second embodiment are described 
with reference to Figs. 17A to 17E. 

10 Fig. 17A shows a plurality of 4:1:1 type luminance signals Y corresponding to 8*2 pixels, Fig. 17B shows a plurality 

of 4:1 :1 type color difference signals Cr (or Cb) corresponding to the 4:1:1 type luminance signals, Fig. 17C shows a 
plurality of 4:2:0 type converted color difference signals Cr (or Cb) obtained according to the fifth color difference signal 
converting method, Fig. 17D shows a plurality of 4:2:0 type converted color difference signals Cr (or Cb) obtained 
according to the sixth color difference signal converting method, and Fig. 17E shows a plurality of 4:2:0 type converted 

'5 color difference signals Cr (or Cb) obtained according to the first color difference signal converting method of the first 
embodiment. 

Here, in cases where a value calculated according to one of the signal conversion equations is not an integral 
number, the value is rounded off to an integral number. Also, in cases where a value of a converted color difference 
signal is not determined because the value is determined by using a value of a color difference signal not indicated in 

20 Fig. 17B, the value is indicated by a sign in Fig. 17C and 17D. 

In cases where 4:2:2 type component picture signals indicating a picture are input to a digital video apparatus to 
record the picture in the digital video apparatus by converting 4:2:2 type color difference signals into 4:1 :1 type color 
difference signals compressed in the DV compression format and the 4:1:1 color difference signals are converted into 
4:2:0 type color difference signals compressed according to MPEG1 or MPEG2, 4:2:2 type color difference signals of 

25 co-ordinates (0,y), (1,y), (2,y) and (3,y) correspond to luminance signals having values 200 for Y co-ordinates (0,y) 
and (1,y), 100 for Y co-ordinates (2,y) and (3,y), 100 for Y co-ordinates (4,y)and (5,y)and 100 for Y co-ordinates (6, y) 
and (7,y), color difference signals of the 4:1:1 color difference signals of co-ordinates (0,y) and (1,y) correspond to 
luminance signals having values 200 for Y co-ordinates (0,y) and (1,y) and 100 for Y co-ordinates (4,y) and (5,y). 
Therefore, because values of the 4:1:1 color difference signals shown in Fig. 17B vary as values of the luminance 

30 signals vary, in cases where the correlation between color information and luminance information generally existing in 
a natural picture is considered, it is preferable that values of the 4:2:0 type converted color difference signal of co- 
ordinates (0,0) and (1,0) be different from each other 

As shown in Fig. 17(E), values of converted color difference signals Cr (or Cb) of co-ordinates (0,0) and (0,1) are 
the same as each other in the first color difference signal converting method of the first embodiment. In contrast, as 

35 shown in Fig. 17(c), values of the converted color difference signals Cr (or Cb) of co-ordinates (0,0) and (0,1) are 
different from each other in the fifth color difference signal converting method. Therefore, a natural picture can be 
faithfully reproduced in the fifth color difference signal converting method as compared with that in the first color dif- 
ference signal converting method. 

Also, as shown in Figs. 17(c) and 17(d), the difference of the values of the converted color difference signals Cr 

40 (or Cb) of co-ordinates (0,0) and (0,1 ) according to the sixth color difference signal converting method is smaller than 
that according to the fifth color difference signal converting method. Therefore, because color information of the con- 
verted color difference signals is concentrated in lower frequency portions, a compression efficiency in an orthogonal 
conversion such as DCT can be improved. 

Accordingly, in cases where the picture signal converting apparatus 21 and one of the fifth and sixth color difference 

45 signal converting methods are used, the 4:1 :1 type component picture signals can be directly converted into the 4:2: 
0 type component picture signals. 

Also, because the luminance signals are referred to determine the 4:2:0 type converted color difference signals 
Cr 1 and Cb", the correlation between color information and luminance information generally existing in a natural picture 
can be included in the converted color difference signals, and an image of the natural picture can be faithfully reproduced 

50 at high definition. 

(Third Embodiment) 

In this embodiment, a picture signal converting apparatus, in which an orthogonal-converted digital compressed 
55 picture signal compressed in a DVC format is converted into an orthogonal-converted digital compressed picture signal 
compressed in an MPEG2 format with motion compensation, is described. 

Fig. 18 is a block diagram of a picture signal converting apparatus according to a third embodiment of the present , 
invention. 
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As shown in Fig. 18, a picture signal converting apparatus 31 comprises 

an input-output unit 32 for receiving an orthogonal-converted digital compressed picture signal compressed in a 
DVC format for each of pixels of a frame and outputting an orthogonal-converted digital compressed picture signal 
5 compressed in an MPEG2 format with motion compensation for each of pixels of a frame, 

a picture signal decoding unit 33 for decoding the compressed picture signals received in the inputoutput unit 32 
to produce non -compressed 4:1:1 type component picture signals, 

a component picture signal converting unit 34 for directly converting the non-compressed 4:1 :1 type component 
picture signals into non-compressed 4:2:0 type component picture signals, and 
10 a picture signal coding unit 35 for coding the non -com pressed 4:2:0 type component picture signals to produce 

the compressed picture signal compressed in the MPEG2 format with motion compensation. 

The input -output unit 32 comprises an input unit 36 for receiving the digital compressed picture signals compressed 
in the DVC format, and an output unit 37 for outputting the digital compressed picture signals compressed in the MPEG2 
is format with motion compensation. 

The picture signal decoding unit 33 comprises 

a preparing unit 38 for deshuffling the digital compressed picture signals shuffled in the compression according to 
the DVC format, 

20 a variable length decoding unit 39 for performing a variable length decoding for the digital compressed picture 

signals deshuffled in the preparing unit 38 to produce a plurality of quantized values of DCT coefficients, 
an inverted quantization unit 40 for performing an inverted quantization for the quantized values of the DCT coef- 
ficients to produce the DCT coefficients, and 

an inverted DCT processing unit 41 for performing an inverted DCT processing for the DCT coefficients to produce 
25 the non-compressed 4:1 :1 type component picture signals. 

The picture signal coding unit 35 comprises 

a coding control unit 42 for specifying a picture type such as an l-picture, a P-picture or a B-picture for a current 

30 frame planned to be encoded in the coding unit 35, 

an input buffer 43 for storing the non-compressed 4:2:0 type component picture signals of trje current frame, 
a DCT compressing unit 44 for performing a DCT processing for the non-compressed 4:2:0 type component picture 
signals to obtain a plurality of DCT coefficients of picture signals and quantizing the DCT coefficients by dividing 
each of the DCT coefficients by a value of a quantized table to obtain a plurality of quantized values of picture 

35 signals, 

an inverted DCT expanding unit 45 for performing an inverted quantization for the quantized values of picture 
signals to produce DCT coefficients of picture signals, performing an inverted DCT processing for the DCT coef- 
ficients obtained in the DCT compressing unit 44 to reproduce the non -compressed 4:2:0 type component picture 
signals, 

40 a frame memory 46 for storing the non -compressed 4: 2:0 type component picture signals reproduced in the inverted 

DCT expanding unit 45 as picture signals of a referential frame, a relationship between the referential frame and 
the current frame being specified by the coding control unit 42, and picture signals newly stored in the input buffer 
43 being set as picture signals of a current frame newly defined, 

a motion predicting unit 47 for predicting the motion of a picture of the current frame by calculating a motion vector 
45 according to the non-compressed 4:2:0 type component picture signals of the referential frame stored in the frame 

memory 46 and the non-compressed 4:2:0 type component picture signals of the current frame stored in the input 
buffer 43 for each macroblock of the current frame and calculating an inter-frame difference according to the dif- 
ference between the non-compressed 4:2:0 type component picture signals of the current frame and non-com- 
pressed 4:2:0 type component picture signals of a corresponding macroblock of the referential frame specified by 
so the motion vector for each macroblock, 

a coding selecting unit 48 for selecting a coding method using the motion vectors or a coding method using no 
motion vector under the control of the coding control unit 42, selecting the quantized values of picture signals 
transmitted from the DCT compressing unit 44 as macroblock information in cases where the l-picture is selected 
by the coding control unit 42 and selecting the motion vectors and the inter-frame differences transmitted from the 
55 motion predicting unit 47 as macroblock information in cases where the B-picture or the P-picture is selected by 

the coding control unit 42, 

a variable length coding unit 49 for performing a variable length coding for the macroblock information selected, 
by the coding selecting unit 48 to produce pieces of variable length coded data, and 
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a structure coding unit 50 for producing the digital compressed picture signals compressed in the MPEG2 format 
with motion compensation from the variable length coded data. 

The picture signal converting apparatus 11 or 21 according to the first or second embodiment is used as the 
5 component picture signal converting unit 34. 

In the above configuration, an operation of the picture signal converting apparatus 31 is described with reference 
to Fig. 19. Fig. 19 shows the whole procedure performed in the picture signal converting apparatus 31. 

In a step S301 , input-output unit 32 for receiving digital compressed picture signals compressed in a DVC format 
are received in the input unit 36 and are decoded in the picture signal decoding unit 33 to produce non-compressed 
w 4:1 ;1 type component picture signals. 

In a step S302, the non-compressed 4:1:1 type component picture signals are directly converted into non-com- 
pressed 4:2:0 type component picture signals in the component picture signal converting unit 34. 

In a step S303, the non-compressed 4:2:0 type component picture signals are coded to compressed picture signals 
compressed in the MPEG2 format with motion compensation, and the compressed picture signals are output from the 
15 outputting unit 37. 

In this case, it is preferred that the operations in the steps S301 to S303 be performed in parallel to each other. 
That is, non-compressed 4:1:1 type component picture signals obtained in the step S301 are directly converted into 
non-compressed 4:2:0 type component picture signals in the step S302 before all non-compressed 4:1 :1 type compo- 
nent picture signals are not obtained in the step S301, and non-compressed 4:2:0 type component picture signals 
20 obtained in the step S302 are coded in the step S303 before all non-compressed 4:2:0 type component picture signals 
are not obtained in the step S302. 

Next, the decoding processing in the step S301 is described in detail. 

A method for obtaining digital compressed picture signals compressed in the DVC format from 4:1:1 type compo- 
nent picture signals is initially described. 

25 To obtain digital picture signals compressed in the DVC format from non-compressed 4: 1 : 1 type component picture 

signals, the DCT processing is performed for each block (8*8 pixels) of 4:1 :1 type component picture signals to obtain 
a DCT block of DCT coefficients from each block, the DCT coefficients of each DCT block are quantized to obtain a 
block of quantized values from each DCT block, the quantized values of each block are coded to a block of variable- 
length codes, and the variable-length codes of the blocks are recorded as digital compressed picture signals com- 

30 pressed in the DVC format. 

Also, a macroblock is composed of four DCT blocks of DCT coefficients corresponding to luminance signals Y and 
two DCT blocks of DCT coefficients corresponding to color difference signals Cr and Cb, a superblock is composed 
of a plurality of macroblocks, and one frame in the DVC format is composed of a plurality of superblocks. Also, a 
shuffling processing is performed for the digital compressed picture signals to change original recording positions of 

35 the macroblocks or the superblocks in one frame to other recording positions, so that the digital compressed picture 
signals compressed in the DVC format are obtained. 

Fig. 20 is a flow chart of the decoding processing performed in the step S301. 

In a step S311 , the digital compressed picture signals shuffled in the DVC format are deshuffled in the preparing 
unit 38, so that information of the macroblocks are arranged in the original positions for each frame. 
40 in a step S312, a variable length decoding is performed for the digital compressed picture signals in the variable 

length decoding unit 39, so that the digital compressed picture signals are converted into variable length decoded 
information indicating a plurality of quantized values of DCT coefficients. 

In a step S313, an inverted quantization is performed for the variable length decoded information in the inverted 
quantization unit 40, so that the DCT coefficients are obtained. 
45 in a step S314, an inverted DCT processing is performed for the DCT coefficients in the inverted DCT processing 

unit 41 to obtain pixel values of pixels for each frame. Therefore, the non -compressed 4:1:1 type component picture 
signals having the pixel values are produced. 

Next, the 4:2:0 type component picture signals coding processing performed in the step S303 is described in detail. 
Fig. 21 is a flow chart of the picture signals coding processing performed in the step S303. 
50 in a step S321, a DCT processing is performed in the DCT compressing unit 44 for the non-compressed 4:2:0 

type component picture signals obtained from the input buffer 43 to obtain a plurality of DCT coefficients ol picture 
signals, and the DCT coefficients are quantized to obtain a plurality of quantized values of picture signals. 

In a step S322, the coding control unit 42 selects a picture type (an l-picture, a P-picture or a B-picture) for the 
current frame processed in the DCT compressing unit 44. Here, an l-picture is predicted by encoding quantized values 
55 of DCT coefficients for the current frame without referring any other frame, a P-picture is predicted by referring com- 
ponent picture signals of a frame preceding to the frame of the P-picture, and a B-picture is predicted by referring 
component picture signals of a frame preceding to the frame of the B-picture and component picture signals of a frame 
succeeding to the frame of the B-picture. 
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In cases where a P-picture or a B-picture is selected for the current frame by the coding control unit 42, the pro- 
cedure proceeds to a step S323. In the step S323. a motion predicting processing is performed, so that the motion of 
a picture drawn in one macroblock is predicted in the motion predicting unit 47 for each macroblock of the current frame 
according to the non-compressed 4:2:0 type component picture signals of the referential frame already stored in the 

5 frame memory 46 and the non-com pressed 4:2:0 type component picture signals of the current frame stored in the 
input buffer 43. That is, in cases where the same particular picture is drawn in a remarked macroblock of the current 
frame and a particular macroblock of the referential frame, a motion vector indicating a positional difference between 
the remarked macroblock of the current frame and the particular macroblock of the referential frame is calculated for 
each macroblock of the current frame. Here, the referential frame is a frame preceding to the current frame in case of 

10 the P-picture, and the referential frame is a frame preceding to the current frame or a frame succeeding to the current 
frame in case of the B-picture. 

Also, inter-frame difference information indicating a difference between a group of pixel values at the remarked 
macroblock of the current frame and a group of pixel values at the particular macroblock of the referential frame is 
calculated for each macroblock of the current frame. Thereafter, the DCT processing and the quantization are performed 

is for the inter-frame difference information in the DCT compressing unit 44, and the motion vectors and the difference 
information DCT-processed and quantized {or the motion vectors and the difference information not DCT-processed 
or quantized) are transmitted to the coding selecting unit 48. 

In a step S324, an inverted quantization is performed in the inverted DCT expanding unit 45 for the quantized 
values of picture signals obtained in the DCT compressing unit 44 to produce DCT coefficients of picture signals, a 

20 DCT processing is performed for the DCT coefficients to reproduce the non -compressed 4:2:0 type component picture 
signals, and the non-compressed 4:2:0 type component picture signals are stored in the frame memory 46 as picture 
signals of the referential frame. 

In a step S325, the coding selecting unit 48 selects either a coding method using the motion vectors or a coding 
method using no motion vector under the control of the coding control unit 42. In cases where a coding method using 

25 the motion vectors is selected, macroblock information (motion vectors and inter-frame difference information DCT- 
processed and quantized) produced in the motion predicting unit 47 is transmitted to the variable length coding unit 
49 for each macroblock. In contrast, in cases where a coding method using no motion vector is selected, macroblock 
information (the quantized values of the picture signals of one macroblock) produced in the DCT compressing unit 44 
are transmitted to the variable length coding unit 49 for each macroblock. 

30 In contrast, in the step S322, in cases where an l-picture is selected for the current frame by the coding control 

unit 42, the quantized values of picture signals obtained in the DCT compressing unit 44 are transmitted to the variable 
length coding unit 49 through the coding selecting unit 48 as macroblock information for each macroblock. Also, the 
quantized values of picture signals are transmitted to the inverted DCT expanding unit 45, and the procedure proceeds 
to a step S326. 

35 in the step S326, an inverted quantization and a DCT processing are performed in the inverted DCT expanding 

unit 45 for the quantized values of picture signals obtained in the DCT compressing unit 44 to reproduce the non- 
compressed 4:2:0 type component picture signals in the same manner in the step S324, and the non-compressed 4: 
2:0 type component picture signals are stored in the frame memory 46 as picture signals of the referential frame. 
Thereafter, the procedure proceeds to a step S327. 

40 in the step S327, a variable length coding is performed in the variable length coding unit 49 for the macroblock 

information transmitted from the coding selecting unit 48. 

In a step S328, a structure coding is performed in the structure coding unit 50 to add a header required for MPEG 
data to variable length codes obtained in the variable length coding unit 49, so that the digital compressed picture 
signals compressed in the MPEG2 format with motion compensation are produced. 

45 Accordingly, even though a user uses a plurality of digital compressed picture signals compressed in the DVC 

format in his computer CI and the user desires to provide the digital compressed picture signals for another computer 
C2, the digital compressed picture signals compressed in the DVC format can be easily converted into a plurality of 
digital compressed picture signals compressed in the MPEG2 format with motion compensation, and the digital com- 
pressed picture signals compressed in the MPEG2 format can be rapidly transmitted to the computer C2 through a 

so network. 

Next, the calculation of a motion vector obtained in the motion predicting processing of the step S323 is described 
in detail. 

In the well-known calculation of the motion vectors, current pixel values at a macroblock of a current frame are 
compared with values of referential pixels placed at each of all macroblocks of a referential frame, errors respectively 
55 indicating the difference between one current pixel value and one corresponding referential pixel value are calculated 
for each macroblock of the referential frame, an average of the errors is calculated as an average error for each mac- 
roblock of the referential frame, a particular macroblock of the referential frame corresponding to a particular average 
error smallest in the average errors is selected, and a positional difference between the macroblock of the current 
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frame and the particular macroblock of the referential frame is calculated as a motion vector indicating a motion of a 
picture for each macroblock of the current frame. That is, one motion vector for one macroblock of the current frame 
designates the particular macroblock of the referential frame. 

In this embodiment of the present invention, a motion vector calculating method, in which a group of motion vectors 
5 is calculated for each of a plurality of hierarchy pictures obtained by gradually lowering the resolution of an original 
picture, is described. 

In this calculating method, a low resolution picture is obtained by reducing the number of pixels in an original picture 
to half, and another low resolution picture is repeatedly obtained by reducing the number of pixels in a previously 
obtained low resolution picture to half. Therefore, a group of low resolution pictures in which the resolution is gradually 

10 lowered is made for each frame. In this specification, a set of the original picture and the low resolution pictures for the 
current frame is called a group of current hierarchy pictures (or simply called a group of hierarchy pictures), and a set 
of the original picture and the low resolution pictures for the referential frame is called a group of referential hierarchy 
pictures (or simply called a group of hierarchy pictures). 

Thereafter, an intermediate motion vector is repeatedly calculated from one current hierarchy picture and one 

15 referential hierarchy picture of the same resolution while changing the current and referential hierarchy pictures to 
those of higher resolution. In this repeated calculations, the intermediate motion vector is set as a rough motion vector 
for each calculation ot the intermediate motion vector, and a plurality of macroblocks placed in the neighborhood of a 
particular macroblock of the referential frame designated by the rough motion vector are set as candidates for another 
particular macroblock of the referential frame designated by a next intermediate motion vector Therefore, when a 

20 motion vector is finally calculated from the current and referential hierarchy pictures (or original pictures) corresponding 
to the highest resolution, the motion vector precisely indicating the motion of the original picture can be obtained. 

A producing method of a plurality of hierarchy pictures is described with reference to Fig. 22. Fig. 22 shows an 
example of a plurality of hierarchy pictures. 

As shown in Fig. 22, a down-sampling (or a pixel decimating processing) is performed for an original picture to 

25 remove every other pixel in the x direction from pixels of the original picture and remove every other pixel in the y 
direction from the pixels, so that a 1/2-resolution picture in which the resolution is reduced to half that of the original 
picture is produced as a hierarchy picture. Also, a down-sampling is performed for the 1/2-resolution picture to produce 
a 1 /4-resolution picture in which the resolution is reduced to a quarter that of the original picture as a hierarchy picture. 
Therefore, in cases where this down-sampling is repeatedly performed for a picture produced just before the<Jown- 

30 sampling, a plurality of hierarchy pictures are produced In this down-sampling, spacial frequency bands in the x and 
y directions are set to half by using low pass filters, and every other pixel is removed from the pixels of each picture. 

Accordingly, in cases where a large object is drawn in a natural picture, the motion of the large object is first 
calculated as a rough motion vector, and the motion of the large object is more precisely determined each time a motion 
vector is calculated from a pair of hierarchy pictures corresponding to a higher resolution while using a rough motion 

35 vector calculated just before the calculation of the motion vector, so that the motion of the large object can be precisely 
calculated. Accordingly, a compression efficiency in the MPEG coding can be heightened, and a reproduced picture 
quality can be improved. 

To perform the motion vector calculating method using a plurality of hierarchy pictures, as shown in Fig. 23, the 
motion predicting unit 47 comprises 

40 

a hierarchy picture producing unit 51 for producing a plurality of current hierarchy pictures from a current original 
picture of the current frame indicated by the picture signals stored in the input buffer 43 and producing a plurality 
of referential hierarchy pictures from a referential original picture of the referential frame indicated by the picture 
signals stored in the frame memory 46, 

a hierarchy picture memory 52 for storing the current hierarchy pictures and the referential hierarchy pictures, 
a motion vector calculating unit 53 for repeatedly calculating an intermediate motion vector from one current hier- 
archy picture, one referential hierarchy picture and a rough motion vector obtained just before the calculation of 
the motion vector while the resolution in the current and referential hierarchy pictures is heightened step-by-step, 
a rough motion vector storing unit 54 for storing the intermediate motion vector as the rough motion vector used 
for the calculation of a next intermediate motion vector in the calculating unit 53 each time the intermediate motion 
vector is calculated in the motion vector calculating unit 53, 

a motion vector producing unit 55 for producing a motion vector from current and referential hierarchy pictures of 
the highest resolution and the intermediate motion vector finally calculated in the motion vector calculating unit 53 
from current and referential hierarchy pictures of the second highest resolution and outputting the motion vector 
to the coding selecting unit 48, and 

an inter-frame difference information producing unit 56 for producing an inter-frame difference information indicat- 
ing a difference between a group of pixel values of one macroblock of the current frame and a group of pixel values, 
of one macroblock of the referential frame corresponding to the motion vector produced in the motion vector pro- 
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ducing unit 55. 

In the above configuration of the motion predicting unit 47, the motion vector calculating method using a plurality 
of hierarchy pictures is described with reference to a flow chart shown in Fig. 24. 

5 In a step S331 . a plurality of current hierarchy pictures and a plurality of referential hierarchy pictures are produced 

from the picture signals stored in the input buffer 43 and the picture signals stored in the frame memory 46 in the 
hierarchy picture producing unit 51 . For example, as shown in Fig. 22, the hierarchy pictures of each frame are com- 
posed of an original picture, a 1/2-resolution picture, 1/4-resolution picture and 1/3-resolution picture. Thereafter, the 
hierarchy pictures are stored in the hierarchy picture memory 52. 

to in a step S332, an intermediate motion vector is repeatedly calculated in the motion vector calculating unit 53. 

That is. the pixels ol the 1/8-resolution picture of the current frame are divided into a plurality of current macroblocks 
respectively composed of 256 pixels (16*16). Also, a plurality of referential macroblocks are produced from the 1/8-res- 
olution picture ol the referential frame in the same manner. Thereafter, as shown in Fig. 25A, current pixel values at a 
remarked current macroblock are compared with referential pixel values at each of all referential macroblocks, errors 

'5 respectively indicating the difference between one current pixel value and one corresponding referential pixel value 
are calculated lor each referential macroblock, an average of the errors is calculated as an average error for each 
referential macroolock. a particular referential macroblock corresponding to a particular average error smallest in the 
average errors is selected and a positional difference between the remarked current macroblock and the particular 
referential macroblock is calculated as an intermediate motion vector. That is, the intermediate motion vector for the 

20 remarked current macroblock of the current frame designates the particular referential macroblock of the referential 
frame, and the in tei mediate motion vector is obtained for each current macroblock. Thereafter, the intermediate motion 
vector is stored in the rough motion vector storing unit 54 as a rough motion vector for each current macroblock. 

Thereafter, as shown in Fig. 25B, a plurality of current macroblocks and a plurality of referential macroblocks are 
produced from the 1/4-resolution picture of the current frame and the 1/4-resolution picture of the referential frame in 

25 the same manner, a rough motion vector corresponding to a remarked current macroblock is obtained from the storing 
unit 54, a specific referential macroblock specified by the rough motion vector is extracted from the referential mac- 
roblocks, a plurality of referential macroblock candidates composed of the specific referential macroblock and a plurality 
of referential macroblocks placed in the neighborhood of the specific referential macroblock are specified, and current 
pixel values at the remarked current macroblock are compared with values of referential pixels placed at each- of the 

30 referential macroblock candidates. Thereafter, an average error is calculated for each referential macroblock candidate, 
a particular referential macroblock corresponding to the smallest average error is selected, and ap intermediate motion 
vector indicating a motion of a picture from the particular referential macroblock to the remarked current macroblock 
is calculated. Thereafter, the intermediate motion vector is stored in the rough motion vector storing unit 54 as a rough 
motion vector for each current macroblock. 

35 Thereafter intermediate motion vectors are calculated for each current macroblock corresponding to the 1/2-res- 

olution pictures in the same manner as those corresponding to the 1/4-resolution pictures. 

In a step S333, a motion vector is finally produced in the motion vector producing unit 55 for each cu rrent macroblock 
of the current frame while using the rough motion vector corresponding to the 1/2-resolution pictures. 

In a step S334, an inter-frame difference information indicating a difference between a group of pixel values of 

40 one current macroblock and a group of pixel values of one referential macroblock specified by the motion vector cor- 
responding to the current macroblock is. produced in the inter-frame difference informatbn producing unit 56. 

For example, in cases where a large object is drawn in a natural picture, the motion of the large object is first 
calculated as an intermediate motion vector, and the motion of the large object is more precisely determined each time 
the intermediate motion vector is calculated from a pair of hierarchy pictures corresponding to a higher resolution while 

is using a rough motion vector calculated just before the calculation of the intermediate motion vector. Therefore, a motion 
vector indicating the motion of the large object can be precisely calculated, and a compression efficiency in the MPEG 
coding can be heightened, and a reproduced picture quality can be improved. 

Accordingly, even though a large object is dynamically moved in a moving picture, because the precision of an 
intermediate motion vector roughly indicating the motion of the large object is gradually heightened while the interme- 

50 ' diate motion vector is recalculated, a motion vector faithfully expressing a natural motion of the large object can be 
finally obtained. Therefore, the digital compressed picture signals compressed in the DVC format can be precisely 
converted into the digital compressed picture signals compressed in the MPEG2 format with motion compensation, 
and a picture indicated by the picture signals compressed in the MPEG2 format with motion compensation can be 
reproduced with high picture quality 

55 Also, because a rough motion vector calculated in a previous stage is used for the calculation of a next intermediate 

motion vector, a calculation volume required for the motion vector calculating method using a plurality of hierarchy 
pictures can be considerably reduced. 

In this embodiment, the motion vector calculating method peculiar to the present invention is used. However, it is 
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applicable that a well-known motion vector calculating method be used to convert the digital compressed picture signals 
compressed in the DVC format into the digital compressed picture signals compressed in the MPEG2 format with 
motion compensation. 

5 (Fourth Embodiment) 

In a picture signal converting apparatus according to this embodiment, an orthogonal -converted digital compressed 
picture signal compressed in a DVC format is converted into an orthogonal-converted digital compressed picture signal 
compressed in an MPEG2 format with motion compensation while DCT coefficients of luminance signals of the DVC 
10 format are used for the production of the digital compressed picture signals of the MPEG2 format. 

Fig. 26 is a block diagram of a picture signal converting apparatus according to a fourth embodiment. 

As shown in Fig. 26, a picture signal converting apparatus 61 comprises 

the input-output unit 32, the picture signal decoding unit 33, the component picture signal converting unit 34, and 
is a picture signal coding unit 62 for coding the non-compressed 4:2:0 type component picture signals to produce 

the compressed picture signal compressed in the MPEG2 format with motion compensation while using DCT 
coefficients of luminance signals of the DVC format for the production of the digital compressed picture signals of 
the MPEG2 format. 

20 The picture signal coding unit 62 comprises the coding control unit 42, the input buffer 43, the DCT compressing 

unit 44, the inverted DCT expanding unit 45, the frame memory 46, 

a DCT coefficient buffer 63 for storing a plurality of DCT coefficients of luminance signals obtained in the inverted 
quantization unit 40, 

25 a hierarchical inverted DCT processing unit 64 for performing a hierarchical inverted DCT processing for the DCT 

coefficients of luminance signals to produce a plurality of hierarchy pictures of the current frame respectively in- 
dicated by non -compressed 4:2:0 type component picture signals, 

a motion predicting unit 65 for predicting the motion of a picture (or a motion vector) according to the non-com- 
pressed 4;2:0 type component picture signals of the referential frame stored in the frame memory 46 and the 
30 hierarchy pictures produced in the hierarchical inverted DCT processing unit 64 for each macroblock and calcu- 

lating an inter-frame difference from the difference between the non-compressed 4:2:0 type component picture 
signals of one macroblock of the current frame and the non-compressed 4:2:0 type component picture signals of 
a corresponding macroblock of the referential frame indicated by the motion vector for each macroblock of the 
current frame, 

35 

the coding selecting unit 48, the variable length coding unit 49, and the structure coding unit 50, 

As shown in Fig. 27, the motion predicting unit 65 comprises 
the hierarchy picture memory 52 for storing the current hierarchy pictures and the referential hierarchy pictures pro- 
duced in the hierarchical inverted DCT processing unit 64, the motion vector calculating unit 53, the rough motion 
40 vector storing unit 54, the motion vector producing unit 55, and the inter-frame difference information producing unit 56. 

In the above configuration, an operation of the picture signal converting apparatus 61 is described. 

In this apparatus 61 , a plurality of DCT coefficients expressing a plurality of luminance signals of non-compressed 
4:1 :1 type component picture signals are transmitted to the picture signal coding unit 62, and a plurality of hierarchy 
pictures are directly produced from the DCT coefficients in the hierarchical inverted DCT processing unit 64. Therefore, 
45 any down-sampling required in the third embodiment to produce a plurality of hierarchy pictures is not required, so that 
the conversion of digital compressed picture signals compressed in the DVC format into digital compressed picture 
signals compressed in the MPEG2 format with motion compensation can be performed at a shortened processing time. 

The whole processing in the apparatus 61 is almost the same as that of the third embodiment shown in Fig. 19. 
That is, a picture signal decoding processing for the DVC format in the step S301 and a picture signal compressing 
50 processing for the MPEG format in the step S303 are different from those in the third embodiment. Fig. 28 is a flow 
chart showing a picture signal decoding (or expanding) processing performed in the picture signal decoding unit 33. 

As shown in Fig. 28, after the steps S311 to S31 3 are performed in the same manner as in the third embodiment, 
it is judged in the inverted quantization unit 40 in a step S31 5 whether or not a DCT block processed in the unit 40 to 
produce a plurality of DCT coefficients corresponds to luminance signals. In cases where the DCT block corresponds 
55 to luminance signals, DCT coefficients of luminance signals included in the DCT block are stored in the DCT coefficient 
buffer 63 in a step S31 6. In contrast, in cases where the DCT block corresponds to color difference signals Cr (or Cb), 
the procedure proceeds to a step S317, an inverted DCT processing is performed in the inverted DCT processing unit 
41 to produce non-compressed 4:1:1 type color difference signals Cr (or Cb) from DCT coefficients of color difference 
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signals included in the DCT block by calculating pixel values of pixels from the DCT coefficients. Thereafter, the non- 
compressed 4:1 :1 type color difference signals are directly converted into the non-compressed 4:2:0 type color differ- 
ence signals in the component picture signal converting unit 34 and are stored in the input buffer 43. In this case, any 
DCT block of DCT coefficients of luminance signals is not processed in the inverted DCT processing unit 41 , and any 
5 non-compressed luminance signal is not processed in the component picture signal converting unit 34. 

Fig. 29 is a flowchart showing a picture signal compressing processing performed in the picture signal coding unit 

62. 

In a step S341 , because the DCT coefficients of luminance signals stored in the DCT coefficient buffer 63 and the 
non-compressed 4:2:0 type color difference signals stored in the input buffer 43 are input to the DCT compressing unit 
io 44, it is judged in the DCT compressing unit 44 whether or not data input to the DCT compressing unit 44 is a DCT 
block of DCT coefficients of luminance signals. In cases where non<;ompressed 4:2:0 type color difference signals 
transmitted from the input buffer 43 are input to trie DCT compressing unit 44, a DCT processing is performed for the 
non-compressed 4:2:0 type color difference signals in a step S342 to produce DCT coefficients of color difference 
signals. In contrast, in cases where DCT coefficients of luminance signals transmitted from the DCT coefficient buffer 
'5 63 are input to the DCT compressing unit 44, any DCT processing is not performed. 

Therefore, in cases where the steps S341 and S342 are repeated, DCT coefficients of 4:2:0 type component 
picture signals of the current frame are prepared in the DCT compressing unit 44. 

In a step S343, the coding control unit 42 selects a frame type (a frame of an I -picture, a frame of a P-picture or 
a frame of a B-picture) for the current frame. 
20 in cases where an l-picture is selected for the current frame by the coding control unit 42, any motion prediction 

is not required, and the procedure proceeds to a step S344. In the step S344, the DCT coefficients of the picture signals 
(the DCT coefficients of the color difference signals and the DCT coefficients of the luminance signals) of the current 
frame are quantized in the DCT compressing unit 44, and the quantized values of the current frame are transmitted to 
the variable length coding unit 49 through the coding selecting unit 48 as macroblock information for each macroblock. 
2S Also, the quantized values of the current frame are transmitted to the inverted DCT expanding unit 45. 

In a step S345, an inverted quantization is performed in the inverted DCT expanding unit 45 for the quantized 
values of picture signals obtained in the DCT compressing unit 44 to produce DCT coefficients of picture signals, a 
DCT processing is performed for the DCT coefficients to reproduce the non-compressed 4:2:0 type component picture 
signals, and the non-compressed 4:2:0 type component picture signals are stored in the frame memory 46 as picture 
30 signals of the referential frame. 

In contrast, in cases where a P-picture or a B-picture is selected for the current frame by the coding control unit 
42, the procedure proceeds to a step S346. In the step S346, a hierarchical inverted DCT processing described later 
in detail is performed in the hierarchical inverted DCT processing unit 64 for the DCT coefficients of luminance signals 
stored in the DCT coefficient buffer 63 to produce a plurality of hierarchy pictures of the current frame, and the hierarchy 
35 pictures are stored in the hierarchy picture memory 52 of the motion predicting unit 65. 

In a step S347, a motion prediction is performed in the motion predicting unit 65 according to the luminance signals 
of the referential frame stored in the frame memory 46 and the hierarchy pictures of the current frame stored in the 
hierarchy picture memory 52, so that a motion vector and inter-frame difference information are obtained for each 
macroblock. In this motion prediction, each of the hierarchy pictures is compared with an original picture of the referential 
40 frame. Thereafter, the motion vectors and the inter-frame difference information (or the inter-frame difference informa- 
tion DCT-processed and quantized in the DCT compressing unit 44) are transmitted to the coding selecting unit 48. 

In a step S348, an inverted DCT processing is performed in the inverted DCT expanding unit 45 for the DCT 
coefficients of the picture signals of the current frame obtained in the DCT compressing unit 44 to reproduce the non- 
compressed 4:2:0 type component picture signals, and the non-compressed 4:2:0 type component picture signals are 
45 stored in the frame memory 46 as picture signals of the referential frame. 

In a step S349, the coding selecting unit 48 selects either a coding method using the motion vectors or a coding 
method using no motion vector under the control of the coding control unit 42. In cases where a coding method using 
the motion vectors is selected, the motion vectors and the inter-frame difference information produced in the motion 
predicting unit 65 are transmitted to the variable length coding unit 49 as macroblock information for each macroblock. 
so in contrast, in cases where a coding method using no motion vector is selected, the quantized values of the picture 
signals produced in the DCT compressing unit 44 are transmitted to the variable length coding unit 49 as macroblock 
information for each macroblock. 

Thereafter, the steps S327 and S328 are performed in the same manner as in the third embodiment. 
Therefore, the digital compressed picture signals compressed in the DVC format can be converted into the digital 
55 compressed picture signals compressed in the MPEG2 format with motion compensation while the DCT coefficients 
of the luminance signals of the DVC format are used to predict the motion of a picture in each frame. 

The hierarchical inverted DCT processing performed in the step S346 is described in detail with reference to Figs, 
30A to 30D. 
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In brief, DCT coefficients of picture signals (or luminance signals in this embodiment) in the DVC format are com- 
posed of various components ranging from a low frequency component to a high frequency component. An inverted 
DCT processing is repeatedly performed for a group of DCT coefficients while adding higher frequency components 
to the group of DCT coefficients step-by-step, and a plurality of hierarchy pictures having different resolutions are 
s produced. 

Figs. 30A to 30D respectively show a DCT block composed of a plurality of DCT coefficients arranged in a matrix 
of rows and columns and a hierarchy picture obtained by performing an inverted DCT processing for a group of DCT 
coefficients selected from the DCT block. 

As shown in Fig. 30A, in a first stage, a direct current component (or the lowest frequency component) arranged 

10 on the top left side of a DCT block is selected, an inverted DCT processing is performed for the direct current component 
to obtain a value of a luminance signal corresponding to the direct current component, and a 1/8-resolution picture 
composed of the luminance signal is, for example, produced. 

As shown in Fig. 30B, in a second stage, four lower components arranged on the upper left side of the DCT block 
are selected, an inverted DCT processing is performed for the four lower components to obtain values of luminance 

is signals corresponding to the lower components, and a 1/4-resolution picture composed of the luminance signals is 
produced. Also, as shown in Fig. 30C, in a third stage, sixteen lower components arranged on the upper left side of 
the DCT block are selected, and a 1/2-resolution picture is produced. Also, as shown in Fig. 30D, in a final stage, all 
components of the DCT block are selected, and an original picture is produced. Therefore, a plurality of hierarchy 
pictures composed of the 1/8- resolution picture, the 1/4-resolution picture, 1/2-resolution picture and the original picture 

20 are obtained. 

In this hierarchical inverted DCT processing, each inverted DCT processing is independent of the other processing. 
However, as shown in Fig. 31, it is applicable that a hierarchy picture obtained in a stage be used for a next stage. 
That is, in the second stage, three lower components not including the direct current component are selected from the 
upper left side of the DCT block, and the 1/4-resolution picture is produced by combining the 1/8-resolution picture 

2S obtained in the first stage and a picture obtained from the three lower components. Also, in the third stage, twelve 
lower components not including a group of four components corresponding to the 1/4-resolution picture are selected 
from the upper left side of the DCT block, and the 1/2-resolution picture is produced by combining the 1/4-resolution 
picture and a picture obtained from the twelve lower components. Also, in the final stage, all components other than 
the sixteen components corresponding to the 1/2-resolution picture are selected, and the original picture is produced 

30 by adding the 1/2-resolution picture. 

Therefore, in this hierarchical inverted DCT processing shown in Fig. 31 , a calculation volume can be reduced. 
Accordingly, because the DCT coefficients of the luminance signals of the DVC format are used as the DCT co- 
efficients of the luminance signals of the MPEG2 format by directly transmitting the DCT coefficients of the luminance 
signals obtained in the inverted quantization unit 40 to the picture coding unit 62 as the DCT coefficients of the luminance 

3S signals of the MPEG2 format without passing the inverted DCT processing unit 41 and the component signal converting 
unit 34, the processing for the conversion of the DCT coefficients of the luminance signals of the DVC format into the 
DCT coefficients of the luminance signals of the MPEG2 format is not required Therefore, the calculation volume 
required for the conversion of the digital compressed picture signals compressed in the DVC format into the digital 
compressed picture signals compressed in the MPEG2 format with motion compensation can be reduced. 

40 Also, because the calculation volume required for the production of the hierarchy pictures in the hierarchical in- 

verted DCT processing unit 64 is almost the same as that required in the inverted DCT processing unit 41 in which the 
inverted DCT processing is performed for the DCT coefficients of the luminance signals of the DVC format in the third 
embodiment, even though the hierarchy pictures is produced, the increase of the calculation volume can be disregard- 
ed. 

45 tn this embodiment, because any of the DCT coefficients of the luminance signals of the DVC format is not trans- 

mitted to the inverted DCT processing unit 41, the component picture signal converting unit 34 does not function as 
the picture signal converting apparatus 21 . However, in cases where the DCT coefficients of the luminance signals of 
the DVC format are transmitted to both the DCT coefficient buffer 63 and the inverted DCT processing unit 41, the 
component picture signal converting unit 34 can function as the picture signal converting apparatus 21 



so 



(Fifth Embodiment) 

In a picture signal converting apparatus according to this embodiment, an orthogonal -converted digital compressed 
picture signal compressed in a DVC format is converted into an orthogonal-converted digital compressed picture signal 
compressed in an MPEG2 format with motion compensation while reducing the calculation volume required for the 
detection of motion vectors. 

Fig. 32 is a block diagram of a picture signal converting apparatus according to a fifth embodiment. 

As shown in Fig. 32, a picture signal converting apparatus 71 comprises 
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the input-output unit 32, the picture signal decoding unit 33, the component picture signal converting unit 34, and 
a picture signal coding unit 72 for coding the non-compressed 4:2:0 type component picture signals to produce 
the compressed picture signal compressed in the MPEG2 format with motion compensation while reducing the 
calculation volume required for the detection of motion vectors. 

5 

The picture signal coding unit 72 comprises 

the coding control unit 42, the input buffer 43, the DCT compressing unit 44, the inverted DCT expanding unit 45, 
the frame memory 46, the DCT coefficient buffer 63, 

10 a one-dimensional inverted DCT processing unit 73 for extracting a first group of DCT coefficients arranged in a 

row from the DCT coefficients of luminance signals stored in the DCT coefficient buffer 63, extracting a second 
group of DCT coefficients arranged in a column from the DCT coefficients of luminance signals stored in the DCT 
coefficient buffer 63, performing a one-dimensional inverted DCT processing for the first group of DCT coefficients 
of luminance signals and the second group of DCT coefficients of luminance signals to obtain one dimensional 

is information (x-directional information and y-directional information), 

a motion predicting unit 74 for predicting the motion of a picture (or a motion vector) according to the non-com- 
pressed 4:2:0 type component picture signals of the referential frame stored in the frame memory 46, the non- 
cornpressed 4:2:0 type component picture signals of the current frame stored in the input buffer 43 for each mac- 
roblock and the one dimensional information obtained in the one-dimensional inverted DCT processing unit 73 

20 and calculating an inter-frame difference according to the motion vectors and the difference between the non- 

compressed 4:2:0 type component picture signals of the referential frame and the non-compressed 4:2:0 type 
component picture signals of the current frame for each macroblock, the coding selecting unit 48, the variable 
length coding unit 49, and the structure coding unit 50. 

25 As shown in Fig. 33, the motion predicting unit 74 comprises the motion vector calculating unit 53, the rough motion 

vector storing unit 54, the motion vector producing unit 55, and the inter-frame difference information producing unit 56. 

The whole processing in the apparatus 71 is almost the same as those of the third and fourth embodiments shown 
in Fig. 19. That is, the steps S301 and 5302 are performed in the apparatus 71 in the same manner as in the fourth 
embodiment, and a picture signal compressing processing in the step S303 is different from that in the fourth embod- 

30 iment. Fig. 34 is a flow chart showing a picture signal compressing processing performed in the picture signal decoding 
unit 72. 

As shown in Fig. 34, after the steps S341 to S342 are performed in the same manner as in the fourth embodiment, 
the coding control unit 42 selects a frame type for the current frame processed in the DCT compressing unit 44 in the 
step S343. 

35 in cases where an l-picture is selected by the coding control unit 42, the DCT coefficients of the picture signals 

(the DCT coefficients of the color difference signals and the DCT coefficients of the luminance signals read out from 
the DCT coefficient buffer 63) of the current frame are quantized in the DCT compressing unit 44 in the step S344, 
and the quantized values of the current frame are transmitted to the variable length coding unit 49 through the coding 
selecting unit 48. Also, in the step S345, an inverted quantization is performed in the inverted DCT expanding unit 45 

40 for the quantized values of picture signals obtained in the DCT compressing unit 44 to produce DCT coefficients of 
picture signals, a DCT processing is performed for the DCT coefficients to reproduce the non-compressed 4:2:0 type 
component picture signals, and the non -compressed 4:2:0 type component picture signals are stored in the frame 
memory 46 as picture signals of the referential frame. 

In contrast, in cases where a P-picture or a B-picture is selected by the coding control unit 42 in the step S343, 

45 the procedure proceeds to a step S351 . In the step S351 , a one-dimensional inverted DCT processing described later 
in detail is performed in the one-dimensional inverted DCT processing unit 73 for the DCT coefficients of luminance 
signals stored in the DCT coefficient buffer 63 to produce one-dimensional information of the current frame, and the 
one-dimensional information is transmitted to the motion predicting unit 74. 

In a step S352, a motion prediction is performed in the motion predicting unit 74 according to luminance signals 

so of the referential frame stored in the frame memory 46 and the one-dimensional information of the current frame, so 
that motion vectors and inter-frame difference information of pixel values are obtained. Thereafter, the motion vectors 
and the inter-frame difference information DCT-processed and quantized in the DCT compressing unit 44 are trans- 
mitted to the coding selecting unit 48. 

Thereafter, the steps S348 and S349 and the steps S327 and S328 are performed in the same manner as in the 

55 fourth embodiment. 

Next, the one-dimensional inverted DCT processing performed in the step S351 and the motion prediction per- 
formed in the step S352 are described in detail with reference to Fig. 35. 

Fig. 35 shows the one-dimensional inverted DCT processing and the motion prediction performed in the one- 
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dimensional inverted DCT processing unit 73 and the motion predicting unit 74. 

As shown in Fig. 35, a plurality of DCT coefficients are arranged in each DCT block in a matrix of rows and columns, 
tn the one-dimensional inverted DCT processing performed in the one-dimensional inverted DCT processing unit 73, 
an x-directional group of DCT coefficients arranged in series in the x direction (or lateral direction) and a y-directional 

s group of DCT coefficients arranged in series in the y direction (or longitudinal direction) are selected from each DCT 
block, an inverted DCT processing is performed for the x<Jirectional group of DCT coefficients and the y-directional 
group of DCT coefficients, and values of eight non-compressed luminance signals arranged in the x direction and 
values of eight non-compressed luminance signals arranged in the y direction are obtained. In this case, the values of 
eight non-compressed luminance signals arranged in the x direction are called x-directional information for one DCT 

'0 block, the values of eight non-compressed luminance signals arranged in the y direction are called y-directional infor- 
mation for one DCT block, and one-dimensional information for one DCT block is composed of the x-directional infor- 
mation and the y-directional information. Thereafter, because one macroblock is composed of 2*2 DCT blocks, x- 
directional information (values of 2*16 luminance signals) for one macroblock is produced by combining four pieces 
of x-directional information corresponding to 2*2 DCT blocks, and y-directional information (values of 16*2 luminance 

'5 signals) for one macroblock is produced by combining four pieces of y-directional information corresponding to 2*2 
DCT blocks. Thereafter, pieces of x-directional information corresponding to one frame and pieces of y-directional 
information corresponding to one frame are produced by repeating the production of the x-directional information and 
y-directional information for the macroblock. 

Thereafter, the motion prediction is performed in motion predicting unit 74. In detail, as shown in Fig. 36, a matching 

20 belween a patten of the x-directional information for one current macroblock corresponding to a remarked current frame 
and a patten of values of 2*1 6 luminance signals of each referential macroblock of the referential frame extracted from 
the frame memory 46 is performed, and a specific referential macroblock of the referential frame is determined Jn the 
same manner as in the third embodiment on condition that an average error for the specific referential macroblock is 
minimum among those for the referential macroblocks of the referential frame. Thereafter, a plurality of referential 

25 macroblock candidates composed of the specific referential macroblock and a plurality of referential macroblocks 
placed in the neighborhood of the specific referential macroblock are specified, a matching between a patten of the y- 
directional information for the remarked current macroblock and a patten of values of 16*2 luminance signals of each 
referential macroblock candidate of the referential frame is performed, a particular referential macroblock of the refer- 
ential frame is determined in the same manner as in the third embodiment on condition that an average error for the 

30 particular referential macroblock is minimum among those for the referential macroblock candidates of the referential 
frame, and a vector connecting the remarked current macroblock and the particular referential macroblock is determined 
as a motion vector of the remarked current macroblock. Therefore, a plurality of motion vectors of the macroblocks of 
the current frame are obtained for performing the motion prediction for each macroblock of the current frame. 

Accordingly, because the number of values used for the calculation in each macroblock is 32 (2*16) though the 

35 number of values in each macroblock is 256 (16*16), the calculation volume in the motion prediction can be considerably 
reduced. Also, because the calculation for the y-directional information is performed for only the specific referential 
macroblocks after the calculation for the x-directional information, the calculation volume in the motion prediction re- 
quired for the y-directional information is not so much. Therefore, the calculation volume in the motion prediction can 
be reduced to almost 1/8 as compared with that in the third embodiment. 

40 in this embodiment, any hierarchy picture used in the third embodiment is not used. However, it is applicable that 

a plurality of hierarchy pictures for the current frame and a plurality of hierarchy pictures for the referential frame be 
used. In this case, the one-dimensional inverted DCT processing is performed for each hierarchy picture of the current 
frame, a matching between a patten of x-directional information for one hierarchy picture of one current macroblock 
and a patten of values ot 2*1 6 luminance signals of each referential macroblock of one hierarchy picture of the referential 

45 frame is performed, and a matching between a patten of y-directional information for one hierarchy picture of one 
current macroblock and a patten of values of 16*2 luminance signals of each referential macroblock candidate of one 
hierarchy picture of the referential frame is performed. 

(Sixth Embodiment) 

so 

In this embodiment, any component signal converting unit used in the third to fifth embodiments is not used, but 
the arrangement of DCT coefficients of 4:1:1 type color difference signals obtained in a picture decoding processing 
as intermediate information is changed to convert a compression format of digital picture signals. 

Fig. 37 is a block diagram of a picture signal converting apparatus according to a sixth embodiment. 
55 As shown in Fig. 37, a picture signal converting apparatus 81 comprises 

the input-output unit 32, 

a picture signal decoding unit 82 for decoding the compressed picture signals of the DVC format received in the 
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input-output unit 32 to produce non-compressed 4:2:0 type component picture signals, and 

the picture signal coding unit 35. 

The picture signal decoding unit 82 comprises the preparing unit 38. the variable length decoding unit 39, the 
s inverted quantization unit 40, 

a DCT coefficient converting unit 83 for extracting DCT coefficients of 4:1 :1 type cobr difference signals from the 
DCT coefficients ol 4:1:1 type component picture signals obtained in the inverted quantization unit 40 and con- 
verting the DCT coefficients of 4: 1 :1 type color difference signals to DCT coefficients of 4:2:0 type color difference 
io signals by changing the arrangement of the DCT coefficients of 4:1:1 type color difference signals, and 

an inverted DCT processing unit 84 for performing an inverted DCT processing for the DCT coefficients of lumi- 
nance signals obtained in the inverted quantization unit 40 and the DCT coefficients of 4:2:0 type color difference 
signals obtained in the DCT coefficient converting unit 83 to produce the non-compressed 4:2:0 type component 
picture signals. 

is 

In the above configuration, an operation of the picture signal converting apparatus 81 is described. 
In this apparatus 81 , because lower frequency components placed on an upper left side in a block of DCT coeffi- 
cients of color difference signals indicates color difference information, a half portion of the DCT coefficients of 4:1 :1 
type color difference signals placed on a lower side (or higher frequency side) is removed to halve a resolution of the 

20 OCT coefficients in a y direction (or longitudinal direction), and a plurality of specific DCT coefficients set to 0 are added 
on a right side (or higher frequency side) of the remaining DCT coefficients to double a resolution of the DCT coefficients 
in an x direction (or lateral direction). Therefore, DCT coefficients of 4:2:0 type color difference signals are obtained 
from the DCT coefficients of 4:1:1 type color difference signals in the DCT coefficient converting unit 83, and non- 
compressed 4:2:0 type component picture signals are produced from the DCT coefficients of 4:2:0 type color difference 

25 signals. 

Fig. 38 is a flow chart showing the whole processing performed in the apparatus 81. 

In a step S401 , the compressed picture signals of the DVC format received in the input-output unit 32 is decoded 
and inversely quantized to DCT coefficients of 4:1:1 type color difference signals in the picture signal decoding unit 
82, and non-compressed 4:2:0 type component picture signals are produced by converting the DCT coefficients.of 4: 
30 1:1 type color difference signals into DCT coefficients of 4:2:0 type color difference signals and performing an inverted 
DCT processing for the DCT coefficients of 4:2:0 type color difference signals. Thereafter, in the step S303, the non- 
compressed 4:2:0 type component picture signals are coded to digital picture signals compressed in the MPEG1 format 
or MPEG2 format. 

Fig. 39 is a flow chart showing a picture decoding processing (step S401) performed in the picture signal decoding 
35 unit 82. 

As shown in Fig. 39, after the steps S311, S312 and S313 are performed in the same manner as in the third 
embodiment, the procedure proceeds to a step S411. In the step S411, a DCT coefficient converting processing is 
performed in" the DCT coefficient converting unit 83 for DCT coefficients of 4: 1 :1 type color difference signals obtained 
in the inverted quantization unit 40, so that DCT coefficients of 4:2:0 type color difference signals, in which a resolution 

40 in the y direction is halved and a resolution in the x direction is doubled as compared with those in the DCT coefficients 
of 4:1:1 type color difference signals, are produced. 

In a step S412, an inverted DCT processing is performed in the inverted DCT processing unit 84 for the DCT 
coefficients of 4:2:0 type color difference signals obtained in the DCT coefficient converting unit 83 and DCT coefficients 
of luminance signals obtained in the inverted quantization unit 40. Therefore, values of non-compressed 4:2:0 type 

45 color differential signals are obtained from the DCT coefficients of 4:2:0 type color difference signals, and values of 
non -compressed luminance signals are obtained from the DCT coefficients of luminance signals. The values of the 
non -compressed 4:2:0 type color differential signals and the values of the non-compressed luminance signals are 
transmitted to the input buffer 43 as values of non-compressed 4:2:0 type component picture signals. 

The DCT coefficient converting processing is described in detail. Fig. 40 shows a component type conversion from 

so 4:1 :1 type to 4:2:0 type in the DCT coefficient converting processing and the inverted DCT processing for DCT coef- 
ficients of 4:2:0 type color difference signals. 

As shown in Fig. 40, a DCT block of 4:1 : 1 type color difference signals is composed of 8*8 DCT coefficients of 8*8 
color difference signals. Because color difference information of color difference signals is mainly included in lower 
frequency components placed on an upper left side of the DCT block, a group of 8*4 DCT coefficients placed on the 

55 upper side of the DCT block is extracted from the DCT block to halve a resolution of DCT coefficients in the y direction, 
and 8*4 DCT coefficients of which values are set to 0 are added on the right side of the group of 8*4 DCT coefficients 
to produce a deformed DCT block of 1 6*4 DCT coefficients. Therefore, a resolution of DCT coefficients in the x direction 
is doubled in the delormed DCT block. Thereafter, when the inverted DCT processing is performed for the deformed 
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DCT block of 16*4 DCT coefficients, values of 16*4 non-compressed color difference signals are obtained as 4:2:0 
type color difference signals. 

Accordingly, because a group of DCT coefficients of 4:1:1 type color difference signals is converted into a group 
of DCT coefficients of 4:2:0 type color difference signals, even though the color component signal converting unit 34 
used in the third to fifth embodiments is not used, the digital picture signals compressed in the DVC format can be 
converted to the digital picture signals compressed in the MPEG1 format or MPEG2 format. 

Also, when a component type conversion from 4: 1 : 1 type to 4:2:0 type is performed in the DCT coefficient converting 
processing, because color difference information of color difference signals is mainly included in lower frequency com- 
ponents of the DCT block and a group of 8*4 DCT coefficients placed on the upper side of the DCT block is extracted 
from the DCT block of 8*8 DCT coefficients, color difference information included in the 8*8 DCT coefficients can be 
almost included in the group of 8*4 DCT coefficients. Therefore : the change of colors in a picture reproduced from the 
4:2:0 type component picture signals is smooth, the colors are not changed unnaturally, and a picture having a high 
color quality can be reproduced. 

Also, because the right half portion of the deformed DCT block of 16*4 DCT coefficients has no relation to color 
difference information, even though 8*4 DCT coefficients set to 0 are added on the right side of the group of 8*4 DCT 
coefficients to produce the deformed DCT block of 16*4 DCT coefficients, an adverse influence of the 8*4 DCT coef- 
ficients set to 0 on a reproduced picture is inconspicuous, and any viewer does not feel an unnatural color change in 
a reproduced picture. 

In this embodiment, the picture coding unit 35 is the same as that in the third embodiment. However, it is applicable 
that the picture coding unit 62 used in the fourth embodiment be used in place of the picture coding unit 35 (refer to 
Fig. 41) or the picture coding unit 72 used in the fifth embodiment be used in place of the picture coding unit 35 (refer 
to Fig. 42). 

(Seventh Embodiment) 

In this embodiment, a multi-format picture providing client-server system, in which a digital picture signal com- 
pressed in a particular format (such as a DVC format, an MPEG1 format or an MPEG2 format) requested by a client 
is provided for the client, is described. 

Fig. 43 is a block diagram ot a multi-format picture providing system according to a seventh embodiment. - 

As shown in Fig. 43, a multi-format picture providing system 81 comprises 

a picture reproducing terminal 92 made of a client computer for outputting a picture output request indicating the 
reception of a plurality of digital picture signals compressed in a particular format such as a DVC format, an MPEG1 
format or an MPEG2 format, receiving the digital picture signals compressed in the particular format and repro- 
ducing a digital picture according to the digital picture signals, 

a picture inputting unit 93 for receiving a plurality of digital picture signals compressed in the CVC format, outputting 
a picture input request indicating the output of digital picture signals compressed in the CVC format and outputting 
the digital picture signals compressed in the CVC format, 

a picture providing unit 94 of a server for receiving the digital picture signals compressed in the CVC format from 
the picture inputting unit 93 when the picture input request is received and outputting the digital picture signals 
compressed in the particular format to the picture reproducing terminal 92 when the picture output request is 
received, and 

a network 95 for connecting the picture reproducing terminal 92, the picture inputting unit 93 and the picture pro- 
viding unit 94 by transmitting information such as the picture output request, the digital picture signals of the par- 
ticular format, the picture input request and the digital picture signals of the particular format. 

The picture providing unit 94 comprises 

a communicating unit 96 for communicating with the picture reproducing terminal 92 and the picture inputting unit 
93 through the network 95, 

a picture signal storing unit 97 for storing the digital picture signals of the CVC format received through the com- 
municating unit 96 and storing the digital picture signals compressed in the particular format, 
a picture signal converting unit 98, realized by the picture signal converting apparatus 31 , 61 , 71 or 81 , for con- 
verting the CVC format of the picture signals stored in the picture signal storing unit 97 to the particular format 
requested by the picture reproducing terminal 92 through the communicating unit 96, and 

a control unit 99 for controlling the operations performed in the communicating unit 96, the picture signal storing 
unit 97 and the picture signal converting unit 98. 
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In the above configuration, an operation of the multi-format picture providing system 91 is described with reference 
to Figs. 44A, 44B, 45A and 45B. 

Fig. 44A is a flow chart showing a picture inputting processing performed in the picture providing unit 94, Fig. 44B 
is a flow chart showing a picture outputting processing performed in the picture providing unit 94, Fig. 45A is a flow 

5 chart showing a picture inputting processing performed in the picture providing unit 94 in cases where a picture signal 
converting processing is performed at a speed higher than a real time speed, and Fig. 45B is a flow chart showing a 
picture outputting processing performed in the picture providing unit 94 in cases where a picture signal converting 
processing is performed at a speed higher than a real time speed. 

A picture inputting processing is described. As shown in Fig. 44A, in a step S501 , when the control unit 99 receives 

10 a picture input request from the picture input unit 93 through the communicating unit 96, the control unit 99 transmits 
an input enabling signal to the picture input unit 93. In a step S502, a plurality of digital picture signals compressed in 
the DVC format input from the picture input unit 93 through the communicating unit 96 are stored in the picture signal 
storing unit 97. In a step S503, the control unit 99 instructs the picture signal converting unit 98 to convert a compression 
format of the digital picture signals, and the picture signal converting unit 98 reads out the digital pictures stored in the 

is picture signal storing unit 97 and converts the DVC format of the signals into the MPEG1 format and the MPEG2 format. 
Thereafter, the digital picture signals compressed in the MPEG1 format and the digital picture signals compressed in 
the MPEG2 format are stored in the picture signal storing unit 97. Therefore, the digital picture signals compressed in 
the DVC format, the digital picture signals compressed in the MPEG1 format and the digital picture signals compressed 
in the MPEG2 format are stored in the picture signal storing unit 97. 

20 A picture outputting processing is described. As shown in Fig. 44B, in a step S511 , when the control unit 99 receives 

a picture output request from the picture reproducing terminal 92 through the communicating unit 96, the control unit 
99 transmits an output enabling signal to the picture reproducing terminal 92. In a step S51 2, the digital picture signals 
compressed in a particular format (for example, the DVC format, the MPEG1 lormat or the MPEG2 format), which is 
indicated by the picture output request, are read out from the picture storing unit 97 and are output to the picture 

25 reproducing terminal 92 through the communicating unit 96. 

Accordingly, even though digital picture signals compressed in a specific format such as the DVC format are input 
to the picture providing unit 94 and the picture reproducing terminal 92 requests digital picture signals compressed in 
a particular format from the picture providing unit 94, because the picture signal converting unit 98 converts the digital 
picture signals compressed in the specific format into the digital picture signals compressed in the particular format, 

30 the picture providing unit 94 can provide the digital picture signals compressed in the particular format for the picture 

reproducing terminal 92. - 

Also, in cases where a picture signal converting processing is performed at a speed higher than a real time speed, 
a picture inputting processing shown in Fig. 45A is described. 

In a step S521 , when the control unit 99 receives a picture input request from the picture input unit 93 through the 

35 communicating unit 96, the control unit 99 transmits an input enabling signal to the picture input unit 93. In a step S522, 
a plurality of digital picture signals compressed in the DVC format are input from the picture input unit 93 through the 
communicating unit 96 and are stored in the picture signal storing unit 97. Thereafter, a picture outputting processing 
shown in Fig. 45B is performed as follows. 

In a step S531, when the control unit 99 receives a picture output request from the picture reproducing terminal 

40 92 through the communicating unit 96, the control unit 99 transmits an output enabling signal to the picture reproducing 
terminal 92. In a step S532, it is judged in the control unit 99 whether or not a particular compression format indicated 
by the picture output request is the DVC format. In cases where the particular compression format indicated by the 
picture output request is the DVC format, the digital picture signals stored in the picture signal storing unit 97 are output 
to the picture reproducing unit 92 through the communicating unit 95 in a step S534. Also, in cases where the particular 

45 compression format indicated by the picture output request is not the DVC format, the procedure proceeds to a step 
S533. In the step S533, the control unit 99 instructs the picture signal converting unit 98 to convert a compression 
format of the digital picture signals into the particular compression format, and the picture signal converting unit 98 
reads out the digital pictures stored in the picture signal storing unit 97 and converts the DVC format of the signals into 
the particular format such as the MPEG1 format or the MPEG2 format. Thereafter, the digital picture signals compressed 

so in the particular compression format are output to the picture reproducing unit 92 in the step S534. 

Accordingly, even though a compression format of the digital picture signals stored in the picture storing unit 97 
is not the particular compression format indicated by the picture output request, because a compression format of the 
digital picture signals stored in the picture storing unit 97 is converted into the particular compression format at a real 
time in the picture signal converting unit 98, the digital picture signals, of which a compression format is the particular 

55 compression format indicated by the picture output request, can be immediately output to the picture reproducing 
terminal 92. 

Having illustrated and described the principles of the present invention in a preferred embodiment thereof, it should 
be readily apparent to those skilled in the art that the invention can be modified in arrangement and detail without 
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departing from such principles. We claim all modifications coming within the scope of the accompanying claims. 



Claims 

5 

1. A picture signal converting apparatus comprising: 

receiving means for receiving a digital picture signal of a 4:1:1 color component type for each of pixels of a 
frame, the digital picture signals being arranged in a matrix of rows and columns; 

color difference signal converting means for directly converting color difference signals of the digital picture 
signals received by the receiving means into converted color difference signals of converted digital picture 
signals of a 4:2:0 color component type by removing color difference signals on every other row from the color 
difference signals of the digital picture signals to halve the number of color difference signals in a y direction, 
adding a color difference signal to a position between each pair of color difference signals adjacent to each 
other in an x direction to double the number of color difference signals in the x direction and setting the color 
difference signals, of which the number is halved in the y direction and is doubled in the x direction, as the 
converted color difference signals of the 4:2:0 color component type, and setting values of the converted color 
difference signals of the 4:2:0 color component type according to values of the color difference signals of the 
digital picture signals received by the receiving means; and 

outputting means for combining luminance signals of the digital picture signals received by the receiving means 
and the converted color difference signals of the converted digital picture signals of the 4:2:0 color component 
type obtained by the color difference signal converting means for each pixel of the frame to produce digital 
picture signals of the 4:2:0 color component type and outputting the digital picture signals of the 4:2:0 color 
component type. 

2. A picture signal converting apparatus according to claim 1 in which the color difference signals of the digital picture 
signals of the 4:1 :1 color component type received by the receiving means are placed at co-ordinates (x,y) of an 
X-Y co-ordinate system, the color difference signal converting means comprises: 

y-directional signal halving means for removing color difference signals on every other row from the color 
difference signals of the digital picture signals to halve the number of color difference signals in the y direction; 
and 

x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals which are obtained by the y-directional signal halving means and are adjacent to each other 
in an X direction, setting a value of one added color difference signal to a value of one color difference signal 
adjacent to the added color difference signal in the x direction for each added color difference signal to double 
the number of color difference signals obtained by the y-directional signal halving means in the x direction and 
outputting the color difference signals as the converted color difference signals of the 4:2:0 color component 
type. 

A picture signal converting apparatus according to claim 1 in which the color difference signals of the digital picture 
signals of the 4:1 :1 color component type received by the receiving means are placed at co-ordinates (x,y) of an 
X-Y co-ordinate system, the color difference signal converting means comprises: 

45 signal value setting means for setting values of two color difference signals of co-ordinates (x,2y) and (x,2y+1 ) 

(or (x,2y+1 ) and (x,2y+2)) adjacent to each other in the y direction to an average of values of the color difference 
signals of the co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1) and (x,2y+2)) for each pair of color difference 
signals of co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1) and (x,2y+2)); 

y-directional signal halving means for removing color difference signals on every other row from the color 
so difference signals, of which the values are set by the signal value setting means, to halve the number of color 

difference signals in the y direction; and 

x-directiona! signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals which are obtained by the y-directional signal halving means and are adjacent to each other 
in an X direction, setting a value of one added color difference signal to a value of a color difference signal 
55 adjacent to the added color difference signal in the x direction for each added color difference signal to double 

the number of color difference signals obtained by the y-directional signal halving means in the x direction and 
outputting the color difference signals as the converted color difference signals of the 4:2:0 color component 
type. 
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4. A picture signal converting apparatus according to claim 1 in which the color difference signals of the digital picture 
signals of the 4:1 :1 color component type received by the receiving means are placed at co-ordinates (x,y) of an 
X-Y co-ordinate system, the color difference signal converting means comprises: 

signal value setting means for setting values of two color difference signals of co-ordinates (x,2y) and (x,2y+1 ) 
(or (x,2y+1 ) and (x,2y+2)) adjacent to each other in the y direction to an average of values of the color difference 
signals of the co-ordinates (x.2y) and (x,2y+1) (or (x,2y+1) and (x,2y+2)) for each pair of color difference 
signals of co-ordinates (x,2y) and (x,2y+1) (or (x,2y+1) and (x,2y+2)); 

y-directional signal halving means for removing color difference signals on every other row 1rom the color 
difference signals, of which the values are set by the signal value setting means, to halve the number of color 
difference signals in the y direction; and 

x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals which are obtained by the y-directional signal halving means and are adjacent to each other 
in an X direction, setting a value of one added color difference signal to an interpolated value of the values of 
the color difference signals placed on both sides of the added color difference signal in the x direction for each 
added color difference signal to double the number of color difference signals obtained by the y-directional 
signal halving means in the x direction and outputting the color difference signals as the converted color dif- 
ference signals of the 4:2:0 color component type. 

20 s. A picture signal converting apparatus according to claim 4 in which the interpolated value of the values of the color 
difference signals set by the x-directional signal doubling means is an average of the values of the color difference 
signals. 

6. A picture signal converting apparatus according to claim 1 in which the color difference signals of the digital picture 
25 signals of the 4:1 :1 color component type received by the receiving means are placed at coordinates (x,y) of an 

X-Y co-ordinate system, the color difference signal converting means comprises: 

average value calculating means for calculating a first average of values of two color difference signals placed 
at co-ordinates (x : 2y) and (x,2y+1) (or (x,2y+1) and (x,2y+2)) adjacent to each other in the y direction and a 
second average of values of two color difference signals placed at co-ordinates (x+1,2y) and (x+1 ,2y+1 ) (or 
(x+1 ,2y+1 ) and (x+1 ,2y+2)) adjacent to each other in the y direction for each group of color difference signals 
of the co-ordinates (x,2y), (x,2y+1 ), (x+1 ,2y) and (x+1 ,2y+1 ) (or (x,2y+1 ), (x,2y+2), (x+1 ,2y+1 ) and (x+1 ,2y+2)); 
interpolated value calculating means for calculating a first interpolated value obtained by weighting the first 
and second averages calculated by the average value calculating means at a first weighting ratio and a second 
interpolated value obtained by weighting the first and second averages at a second weighting ratio for each 
pair of first and second averages: 

signal value setting means for setting the first interpolated value calculated by the interpolated value calculating 
means as values of the color difference signals of the co-ordinates (x,2y) and (x t 2y+1) (or (x : 2y+1) and (x, 
2y+2)); 

y-directional signal halving means for removing color difference signals on every other row from the color 
difference signals, of which the values are set by the signal value setting means, to halve the number of color 
difference signals in the y direction; and 

x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals adjacent to each other in an X direction, setting a value of one added color difference signal 
to the second interpolated value calculated by the interpolated value calculating means for each added color 
difference signal to double the number of color difference signals obtained by the y-directional signal halving 
means in the x direction and outputting the color difference signals as the converted color difference signals 
of the 4:2:0 color component type. 

so 7. A picture signal converting apparatus according to claim 1 , further comprising: 

luminance signal storing means for storing a plurality of luminance signals of the digital picture signals received 
by the receiving means, pixels of the luminance signals being placed at co-ordinates (x,y) of an X-Y luminance 
co-ordinate system; and 

55 referential luminance signal extracting means for extracting a plurality of luminance signals corresponding to 

the color difference signals directly converted by the color difference signal converting means from the lumi- 
nance signal storing means as a plurality of referential luminance signals, values of the converted color dif- 
ference signals obtained by the color difference signal converting means being determined according to values 
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of the referential luminance signals. 

8. A picture signal converting apparatus according to claim 6 in which the color difference signals of the digital picture 
signals of the 4:1:1 color component type received by the receiving means are placed at co-ordinates (x,y) of an 

5 X-Y co-ordinate system, the color difference signal converting means comprises: 

average value calculating means for calculating an average of values of two color difference signals placed 
at co-ordinates (x,2y) and (x,2y+1 ) adjacent to each other in the y direction for each pair of color difference 
signals; 

10 weighting factor calculating means for obtaining the referential luminance signals extracted by the referential 

luminance signal extracting means as first referential luminance signals on condition that the first referential 
luminance signals correspond to the color difference signals of co-ordinates (x,2y) and (x+1 ,2y), calculating 
a first weighting factor and a second weighting factor from values of the first referential luminance signals, 
obtaining the referential luminance signals extracted by the referential luminance signal extracting means as 

75 second referential luminance signals on condition that the second referential luminance signals correspond 

to the color difference signals of co-ordinates (x,2y+1 ) and (x+1 ,2y+1 ) and calculating a third weighting factor 
and a fourth weighting factor from values of the second referential luminance signals; 
interpolated value calculating means for calculating a first multiplied value by multiplying the value of the color 
difference signal of the co-ordinates (x,2y) by the first weighting factor obtained by the weighting factor calcu- 

20 fating means, calculating a second multiplied value by multiplying the value of the color difference signal of 

the co-ordinates (x+1,2y) by the second weighting factor obtained by the weighting factor calculating means, 
calculating a third multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x,2y+1 ) by the third weighting factor obtained by the weighting factor calculating means, calculating a fourth 
multiplied value by multiplying the value of the color difference signal of the co-ordinates (x+1,2y+1) by the 

2S fourth weighting factor obtained by the weighting factor calculating means and calculating an interpolated 

value from the first, second, third and fourth multiplied values; 

signal value setting means for setting each average calculated by the average value calculating means as 
values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1 ); 

y-directional signal halving means for removing color difference signals on every other row Irom the color 
30 difference signals, of which the values are set by the signal value setting means, to halve the number of color 

difference signals in the y direction; and 

x-directional signal doubling means for adding a color difference signal to a position between each pair of color 
difference signals adjacent to each other in an X direction, setting a value of one added color difference ^na! 
to the interpolated value calculated by the interpolated value calculating means for each added color differ ence 
35 signal to double the number of color difference signals obtained by the y-directional signal halving means in 

the x direction and outputting the color difference signals as the converted color difference signals of the 4:2: 
0 color component type. 

9. A picture signal converting apparatus according to claim 6 in which the color difference signals of the digital picture 
40 signals of the 4:1 :1 color component type received by the receiving means are placed at co-ordinates (x,y) of an 

X-Y co-ordinate system, the color difference signal converting means comprises: 

weighting factor calculating means for obtaining the referential luminance signals extracted by the referential 
luminance signal extracting means as first referential luminance signals on condition that the first referential 

45 luminance signals correspond to the color difference signals of co-ordinates (x,2y) and (x+1 ,2y), calculating 

a first weighting factor, a second weighting factor, a third weighting factor and a fourth weighting factor from 
values of the first referential luminance signals, obtaining the referential luminance signals extracted by the 
referential luminance signal extracting means as second referential luminance signals on condition that the 
second referential luminance signals correspond to the color difference signals of co-ordinates (x,2y+1) and 

50 (x+1 ,2y+1 ) and calculating a fifth weighting factor and a sixth weighting factor, a seventh weighting factor and 

an eighth weighting factor from values of the second referential luminance signals; 

interpolated value calculating means for calculating a first multiplied value by multiplying the value of the color 
difference signal of the co-ordinates (x,2y) by the first weighting factor obtained by the weighting factor calcu- 
lating means, calculating a second multiplied value by multiplying the value of the color difference signal of 
55 the co-ordinates (x+1 ,2y) by the second weighting factor obtained by the weighting factor calculating means, 

calculating a third multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x t 2y+1) by the fifth weighting factor obtained by the weighting lactor calculating means, calculating a fourth 
multiplied value by multiplying the value of the color difference signal of the co-ordinates (x+1,2y+1) by the 
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sixth weighting factor obtained by the weighting factor calculating means, calculating a first interpolated value 
from the first, second, third and fourth multiplied values, calculating a fifth multiplied value by multiplying the 
value of the color difference signal of the co-ordinates (x,2y) by the third weighting factor obtained by the 
weighting factor calculating means, calculating a sixth multiplied value by multiplying the value of the color 

5 difference signal of the co-ordinates (x+1 ,2y) by the fourth weighting factor obtained by the weighting factor 

calculating means, calculating a seventh multiplied value by multiplying the value of the color difference signal 
of the coordinates (x,2y+ 1 ) by the seventh weighting factor obtained by the weighting factor calculating means, 
calculating an eighth multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x + l.2y+l) by the eighth weighting factor obtained by the weighting factor calculating means, calculating a 

10 second interpolated value from the fifth, sixth, seventh and eighth multiplied values; 

signal value setting means for setting the first interpolated value calculated by the interpolated value calculating 
means as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1); 
y-dtrcctional signal halving means for removing color difference signals on every other row from the color 
dilierence signals, of which the values are set by the signal value setting means, to halve the number of color 

is difference signals in the y direction; and 

x-dircctional signal doubling means for adding a color difference signal to a position between each pair of color 
dilierence signals which are obtained by the y-directional signal halving means and are adjacent to each other 
in an X direction, setting a value of one added color difference signal to the second interpolated value calculated 
by the interpolated value calculating means for each added color difference signal to double the number color 

20 dilierence signals obtained by the y-direclional signal halving means in the x direction and outputling the color 

diffeience signals as the converted color difference signals of the 4:2:0 color component type. 



10. A picture signal converting method, comprising the steps of: 

25 receiving a digital picture signal of a 4:1:1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x.y) of an X-Y co-ordinate system (x=0, 1,2,3,--, and 
y=0, 1.2,3.-) from the digital picture signals; 

halving the number of color difference signals in a y direction by removing color difference signals placed at 
co-ordinates (x,2y) of even-numbered y values or co-ordinates (x,2y+1 ) of odd-numbered y values; . 

jo doubling the number of color difference signals in an x direction by adding a color difference signal to a position 

between each pair of color difference signals adjacent to each other in the X direction; ^ 
setting a value of one added color difference signal to a value of one color difference signal adjacent to the 
added color difference signal in the x direction for each added color difference signal to produce converted 
color difference signals of a 4:2:0 color component type from the color difference signals in which the number 

35 of converted color difference signals is halved in the y direction as compared with the number of color difference 

signals and the number of converted color difference signal is doubled in the x direction as compared with the 
number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4:2:0 color component type; and 
40 outputting the digital picture signals of the 4:2:0 color component type. 

11. A picture signal converting method, comprising the steps of: 

receiving a digital picture signal of a 4:1:1 color component type for each of pixels of a frame; 
45 extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,l ,2,3,--. and 

y=0, 1,2,3,-) from the digital picture signals; 

calculating an average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1 ) (or (x,2y+1 ) 

and (x,2y+2)) adjacent to each other in a y direction for each pair of color difference signals; 

setting each average as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1) (or (x, 

so 2y+1)and (x,2y+2)); 

halving the number of color difference signals in the y direction by removing color difference signals placed 
at co-ordinates (x,2y) of even-numbered y values or co-ordinates (x,2y+1) of odd-numbered y values; 
doubling the number of color difference signals in an x direction by adding a color difference signal to a position 
between each pair of color difference signals adjacent to each other in the X direction; 

55 setting a value of one added color difference signal to a value of one color difference signal adjacent to the 

added color difference signal in the x direction for each added color difference signal to produce converted 
color difference signals of a 4:2:0 color component type from the color difference signals in which the number 
of converted colordifference signals is halved in the y direction as compared with the number of color difference 
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signals and the number of converted color difference signal is doubled in the x direction as compared with the 
number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4:2:0 color component type; and 
outputting the digital picture signals of the 4:2:0 color component type. 



12. A picture signal converting method, comprising the steps of: 



receiving a digital picture signal of a 4:1:1 color component type for each of pixels of a frame; 
10 extracting color difference signals placed at co-ordinates (x.y)ofan X-Y co-ordinate system (x=0,1,2,3," and 

y=0, 1,2,3,--) from the digital picture signals; 

calculating an average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1 ) (or (x,2y+1 ) 

and (x,2y+2)) adjacent to each other in a y direction for each pair of color difference signals; 

setting each average as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1) (or (x, 

is 2y+1)and(x,2y+2)); 

halving the number of color difference signals in the y direction by removing color difference signals placed 
at co-ordinates (x,2y) of even-numbered y values or co-ordinates (x,2y+1 ) of odd-numbered y values; 
adding a color difference signal to a position between each pair of color difference signals adjacent to each 
other in an X direction to double the number of color difference signals in the x direction; 

20 setting a value of one added color difference signal to an interpolated value of the values of the color difference 

signals placed on both sides of the added color difference signal in the x direction for each added color differ- 
ence signal to produce converted color difference signals of a 4:2:0 color component type from the color 
difference signals in which the number of converted color difference signals is halved in the y direction as 
compared with the number of color difference signals and the number of converted color difference signal is 

2S doubled in the x direction as compared with the number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4:2:0 color component type; and 
outputting the digital picture signals of the 4:2:0 color component type. 



30 



13. A picture signal converting method, comprising the steps of: 



receiving a digital picture signal of a 4:1:1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,1 ,2,3,--, and 

y=0, 1,2,3,—) from the digital picture signals; 

3S calculating a first average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+1) (or (x, 

2y+1 ) and (x,2y+2)) adjacent to each other in a y direction and a second average of values of two color dif- 
ference signals of co-ordinates (x+1 ,2y) and (x+1 ,2y+1 ) (or (x+1 ,2y+1 ) and (x+1 ,2y+2)) adjacent to each other 
in the y direction for each group of color difference signals of the co-ordinates (x,2y), (x,2y+1), (x+1,2y) and 
(x+1 ,2y+1 ) (or (x,2y+1 ), (x,2y+2), (x+1 ,2y+1 ) and (x+1 ,2y+2)); 

40 calculating a first interpolated value obtained by weighting the first and second averages at a first weighting 

ratio and a second interpolated value obtained by weighting the first and second averages at a second weight- 
ing ratio for each pair of first and second averages; 

setting the first interpolated value as values of the color difference signals of the co-ordinates (x,2y) and (x, 
2y+1 ) (or (x,2y+1 ) and (x,2y+2)); 

45 halving the number of color difference signals in the y direction by removing color difference signals placed 

at co-ordinates (x,2y) of even-numbered y values or co-ordinates (x,2y+1) of odd-numbered y values; 
adding a color difference signal to a position between each pair of color difference signals adjacent to each 
other in an X direction to double the number of color difference signals in the x direction; 
setting a value of one added color difference signal to the second interpolated value for each added color 

so difference signal to produce converted color difference signals of a 4:2:0 color component type from the color 

difference signals in which the number of converted color difference signals is halved in the y direction as 
compared with the number of color difference signals and the number of converted color difference signal is 
doubled in the x direction as compared with the number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
55 digital picture signals of the 4:2:0 color component type; and 

outputting the digital picture signals of the 4:2:0 color component type. 

14. A picture signal converting method, comprising the steps of: 
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receiving a digital picture signal of a 4:1 : 1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,1 ,2,3,-, and 

y=0, 1,2,3,--) from the digital picture signals; 

calculating an average of values of two color difference signals of co-ordinates (x,2y) and (x,2y+i) adjacent 
to each other in the y direction for each pair of color difference signals; 

extracting luminance signals placed at co-ordinates (x,y) of an X-Y luminance co-ordinate system from the 

digital picture signals as first referential luminance signals on condition that the first referential luminance 

signals correspond to the color difference signals of co-ordinates (x,2y) and (x+1 ,2y); 

calculating a first weighting factor and a second weighting factor from values of the first referential luminance 

signals; 

extracting other luminance signals of the X-Y luminance co-ordinate system from the digital picture signals as 
second referential luminance signals on condition that the second referential luminance signals correspond 
to the color difference signals of co-ordinates (x,2y+1 ) and (x+1 ,2y+1 ); 

calculating a third weighting factor and a fourth weighting factor from values of the second referential luminance 
signals; 

calculating a first multiplied value by multiplying the value of the color difference signal of the co-ordinates (x, 
2y) by the first weighting factor, calculating a second multiplied value by multiplying the value of the color 
difference signal of the co-ordinates (x+1,2y) by the second weighting factor, calculating a third multiplied 
value by multiplying the value of the color difference signal of the co-ordinates (X,2y+1 ) by the third weighting 
factor, calculating a fourth multiplied value by multiplying the value of the color difference signal of the co- 
ordinates (x+1 ,2y+1 ) by the fourth weighting factor and calculating an interpolated value from the first, second, 
third and fourth multiplied values; 

setting each average as values of the color difference signals of the co-ordinates (x,2y) and (x,2y+1); 
halving the number of color difference signals in the y direction by removing color difference signals placed 
at co-ordinates (x,2y) of even-numbered y values or co-ordinates (x,2y+1) of odd-numbered y values; 
adding a color difference signal to a position between each pair of color difference signals adjacent to each 
other in an X direction to double the number of color difference signals in the x direction; 
setting a value of one added color difference signal to the interpolated value for each added color difference 
signal to produce converted color difference signals of a 4:2:0 color component type from the color difference 
signals in which the number of converted color difference signals is halved in the y direction as compared with 
the number of color difference signals and the number of converted color difference signal is doubled in the 
x direction as compared with the number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4:2:0 color component type; and 
outputting the digital picture signals of the 4:2:0 color component type. 

15. A picture signal converting method, comprising the steps of: 

receiving a digital picture signal of a 4:1 : 1 color component type for each of pixels of a frame; 

extracting color difference signals placed at co-ordinates (x,y) of an X-Y co-ordinate system (x=0,1 ,2,3,--, and 

y=0, 1,2,3,--) from the digital picture signals; 

extracting luminance signals placed at co-ordinates (x,y) of an X-Y luminance co-ordinate system from the 
digital picture signals as first referential luminance signals on condition that the first referential luminance 
signals correspond to the color difference signals of co-ordinates (x,2y) and (x+1 ,2y); 

calculating a first weighting factor, a second weighting factor, a third weighting factor and a fourth weighting 
factor from values of the first referential luminance signals; 

extracting other luminance signals from the digital picture signals as second referential luminance signals on 
condition that the second referential luminance signals correspond to the color difference signals of co-ordi- 
nates (x,2y+1 ) and (x+1 ,2y+1 ); 

calculating a fifth weighting factor and a sixth weighting factor, a seventh weighting factor and an eighth weight- 
ing factor from values of the second referential luminance signals; 

calculating a first multiplied value by multiplying the value of the color difference signal of the co-ordinates (x, 
2y) by the first weighting factor; 

calculating a second multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x+1 ,2y) by the second weighting factor; 

calculating a third multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x,2y+1 ) by the fifth weighting factor: 

calculating a fourth multiplied value by multiplying the value of the color difference signal of the co-ordinates 
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(x+1 ,2y+1) by the sixth weighting factor; 

calculating a first interpolated value from the first, second, third and fourth multiplied values; 
calculating a fifth multiplied value by multiplying the value of the color difference signal of the co-ordinates (x, 
2y) by the third weighting factor; 
5 calculating a sixth multiplied value by multiplying the value of the color difference signal of the co-ordinates 

(x+1 ,2y) by the fourth weighting factor; 

calculating a seventh multiplied value by multiplying the value of the color difference signal of the co-ordinates 
(x.2y+1 ) by the seventh weighting factor; 

calculating an eighth multiplied value by multiplying the value of the color difference signal of the co-ordinates 
w (x+1,2y+1) by the eighth weighting factor; 

calculating a second interpolated value from the fifth, sixth, seventh and eighth multiplied values; 

setting the first interpolated value as values of the color difference signals of the co-ordinates (x,2y) and (x, 

2y*t): 

halving the number of color difference signals in the y direction by removing color difference signals placed 
15 at co-ordinates (x.2y) of even-numbered y values or co-ordinates (x,2y+1) of odd-numbered y values; 

adding a color difference signal to a position between each pair of color difference signals adjacent to each 
other in an X direction to double the number of color difference signals in the x direction; 
setting a value of one added color difference signal to the second interpolated value for each added color 
difference signal to produce converted color difference signals of a 4:2:0 color component type from the color 
20 difference signals in which the number of converted color difference signals is halved in the y direction as 

compaied with the number of color difference signals and the number of converted color difference signal is 
doubled in the x direction as compared with the number of color difference signals; 

combining the converted color difference signals and luminance signals of the digital picture signals to produce 
digital picture signals of the 4:2:0 color component type; and 
25 outputting the digital picture signals of the 4:2:0 color component type. 

16. A picture signal converting apparatus comprising: 

receiving means for receiving a digital picture signal compressed in a first format for each of pixels of a frame; 
picture decoding means for decoding the digital picture signals received by the receiving means to produce 
a plurality of non-compressed picture signals of a 4:1:1 color component type, the non-compressed picture 
signals being arranged in a matrix of rows and columns; 

component signal converting means for directly converting color difference signals of the non-compressed 
picture signals obtained by the picture decoding means into converted color difference signals of a 4:2:0 color 
component type by removing color difference signals on every other row from the color difference signals of 
the non-compressed picture signals to halve the number of color difference signals in a y direction and adding 
a color difference signal to a position between each pair of color difference signals adjacent to each other in 
an x direction to double the number of color difference signals in the x direction, setting values of the converted 
color difference signals of the 4:2:0 color component type according to values of the color difference signals 
of the non-compressed picture signals obtained by the picture decoding means and combining luminance 
signals of the non-compressed picture signals obtained by the picture decoding means and the converted 
color difference signals of the 4:2:0 color component type obtained by the color difference signal converting 
means for each pixel of the frame to produce non-compressed picture signals of the 4:2:0 color component 
type; 

picture coding means for coding the non-compressed picture signals of the 4:2:0 color component type ob- 
tained by the component signal converting means to produce a plurality of digital picture signals compressed 
in a second format different from the first format; and 

output means for outputting the digital picture signals compressed in the second format obtained by the picture 
coding means. 

17. A picture signal converting apparatus according to claim 16 in which the first format of the digital picture signals 
received by the receiving means is a DVC format, the digital picture signals compressed in the DVC format being 
obtained by performing a discrete cosine transform (DCT) processing for each block of non-compressed picture 
signals of a 4:1 :1 color component type to obtain a block of DCT coefficients from each block of non-compressed 
picture signals, quantizing each block of DCT coefficients to obtain a block of quantized values from each block 
of DCT coefficients, coding each block of quantized values to obtain a block of variable-length codes from each 
block of quantized values and recording each block of variable-length codes as the digital picture signals com- 
pressed in the DVC format, and the second format of the digital picture signals obtained by the picture coding 
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means is a moving picture experts group (MPEG) format in which a time-redundancy between frames is reduced 
by performing a motion compensation, a space-redundancy in each frame is reduced by performing a discrete 
cosine transform and a code volume is reduced by performing a variable length coding. 

18. A picture signal converting apparatus according to claim 16 in which the picture decoding means comprises 

preparing means for deshuffling the digital picture signals to rearrange the digital picture signals; 
variable-length decoding means for performing a variable-length decoding for the digital picture signals de- 
shuffled by the preparing means to produce a plurality of quantized values; 

inverted quantization means for performing an inverted quantization for the quantized values produced by the 
variable-length decoding means to produce a plurality of blocks of discrete cosine transform (DCT) coefficients 
of the non-compressed picture signals of the 4:1:1 color component type; and 

inverted DCT processing means for performing an inverted DCT processing for each block ol DCT coefficients 
produced by the inverted quantization means to produce a plurality of blocks of non -compressed picture signals 
of the 4:1 :1 color component type, and 
the picture coding means comprises 

an input buffer for storing the non -compressed picture signals of the 4:2:0 color component type produced by 
the component signal converting means as picture signals of a current frame frame by frame, the non-com- 
pressed picture signals being classified into a plurality of blocks ol non -compressed picture signals respectively 
corresponding to a block of the current frame; 

DCT compressing means for performing a discrete cosine transform (DCT) processing for each block of non- 
compressed picture signals stored in the input buffer to obtain a plurality of blocks of discrete cosine transform 
(DCT) coefficients and quantizing the DCT coefficients to obtain a plurality of blocks of quantized values; 
inverted DCT expanding means for performing an inverted DCT processing for the blocks of DCT coefficients 
obtained by the DCT compressing means to reproduce the blocks of non-compressed picture signals of the 
4:2:0 color component type; 

frame picture storing means for storing each block of non -compressed picture signals of the 4:2:0 color com- 
ponent type reproduced by the inverted DCT expanding means as picture signals of a block of a referential 
frame, other non-compressed picture signals of the 4:2:0 color component type corresponding to a frame 
succeeding to the referential frame being stored in the input buffer; 

motion predicting means for calculating a motion vector indicating the motion of a picture according to one 
block of non-compressed picture signals of the current frame stored in the input buffer and the non-compressed 
picture signals of the 4:2:0 color component type of the referential frame stored in the frame picture storing 
means for each block of the current frame and calculating an inter-frame difference between one block of non- 
compressed picture signals of the current frame and a corresponding block of non-compressed picture signals 
of the referential frame indicated by the motion vector for each block of the current frame; 
coding selecting means for selecting a type of coding performed for the quantized values of the current frame 
obtained by the DCT compressing means; 

variable length coding means for performing a variable length coding for the quantized values obtained by the 
DCT compressing means according to the coding type selected by the coding selecting means, the motion 
vectors and the inter-frame differences calculated by the motion predicting means to produce pieces of variable 
length coded data; and 

structure coding means for producing the digital picture signals compressed in the second format from the 
variable length coded data obtained by the variable length coding means. 

19. A picture signal converting apparatus according to claim 1 6 in which the picture coding means comprises 

an input buffer for storing the non-compressed picture signals of the 4:2:0 color component type produced by 
the component signal converting means as picture signals of a current frame frame by frame, the non-com- 
pressed picture signals being classified into a plurality of blocks of non-compressed picture signals respectively 
corresponding to a block of the current frame; 

DCT compressing means for performing a discrete cosine transform (DCT) processing for each block of non- 
compressed picture signals stored in the input buffer to obtain a plurality of blocks of discrete cosine transform 
(DCT) coefficients and quantizing the DCT coefficients to obtain a plurality of blocks of quantized values; 
inverted DCT expanding means for performing an inverted DCT processing for the blocks of DCT coefficients 
obtained by the DCT compressing means to reproduce the blocks of non -com pressed picture signals of the 
4:2:0 color component type; 

frame picture storing means for storing each block of non-compressed picture signals of the 4:2:0 color com- 
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ponent type reproduced by the inverted DCT expanding means as picture signals of a block of a referee :ii 
frame, other non-compressed picture signals of the 4:2:0 color component type corresponding to a frame 
succeeding to the referential frame being stored in the input buffer; 

motion predicting means for calculating a motion vector indicating the motion of a picture according to one 
block of non-compressed picture signals of the current frame stored in the input buffer and the non-compressed 
picture signals of the 4:2:0 color component type of the referential frame stored in the frame picture storing 
means for each block of the current frame and calculating an inter-frame difference between one block of non- 
compressed picture signals of the current frame and a corresponding block of non-compressed picture signals 
of the referential frame indicated by the motion vector for each block of the current frame; and 
coding means for coding the quantized values obtained by the DCT compressing means by using the motion 
vectors and the inter-frame differences calculated by the motion predicting means to produce the digital picture 
signals compressed in the second format, 
the motion predicting means comprises 

hierarchy picture producing means for producing a plurality of current hierarchy pictures of different resolutions 
from a current original picture of each block of the current frame indicated by one block of non -compressed 
picture signals stored in the input buffer and producing a plurality of referential hierarchy pictures from a ref- 
erential original picture of each block of the referential frame indicated by one block of non -com pressed picture 
signals stored in the frame picture storing means, a current hierarchy picture of the highest resolution being 
the current original picture, a current hierarchy picture of a resolution lower than that of a specific current 
hierarchy picture being obtained each time every other pixel is removed in an x direction from pixels of the 
specific current original picture and every other pixel is removed in a y direction from pixels of the specific 
current original picture, a referential hierarchy picture of the highest resolution being the referential original 
picture, and a referential hierarchy picture of a resolution lower than that of a specific referential hierarchy 
picture being obtained each time every other pixel is removed in an x direction from pixels of the specific 
referential original picture and every other pixel is removed in a y direction from pixels of the specific referential 
original picture; 

motion vector producing means for repeatedly calculating an intermediate motion vector from one current 
hierarchy picture and one referential hierarchy picture produced by the hierarchy picture producing means 
and a rough motion vector calculated just before the calculation of the intermediate motion vector while chang- 
ing the current and referential hierarchy pictures to other current and referential hierarchy pictures of higher 
resolution for each calculation of the intermediate motion vector and setting the intermediate motion vector as 
the rough motion vector for each calculation of the intermediate motion vector, and finally calculating the motion 
vector from the current and referential hierarchy pictures of the highest resolution, the motion vector being 
calculated for each block of the current frame, the motion vector for a block of the current frame indicating a 
block of the referential frame, and the rough motion vector indicating candidates for a particular block of the 
referential frame indicated by the intermediate motion vector; and 

inter-frame difference information producing means for producing inter-frame difference information indicating 
the inter-frame difference between a group of pixel values of one block of the current frame and a group of 
pixel values of a corresponding block of the referential frame indicated by the motion vector produced by the 
motion vector producing means for each block of the current frame. 

A picture signal converting apparatus according to claim 16 in which the picture decoding means comprises 

variable-length decoding means for performing a variable-length decoding for the digital picture signals to 
produce a plurality of quantized values; 

inverted quantization means for performing an inverted quantization for the quantized values produced by the 
variable-length decoding means to produce a plu rality of blocks of discrete cosine transform (DCT) coefficients 
of the non-compressed picture signals of the 4:1:1 color component type, the DCT coefficients of the non- 
compressed picture signals being classified into DCT coefficients of non-compressed luminance signals and 
DCT coefficients of non -compressed color difference signals; and 

inverted DCT processing means for performing an inverted DCT processing for each block of DCT coefficients 
of non-compressed color difference signals produced by the inverted quantization means to produce a plurality 
of blocks of non-compressed color difference signals of the 4:1:1 color component type, a plurality of blocks 
of non-compressed color difference signals of the 4:2:0 color component type being produced from the blocks 
of non-compressed color difference signals of the 4:1 :1 color component type by the component signal con- 
verting means, 

the picture coding means comprises 

an input buffer for storing the non-compressed picture signals of the 4:2:0 color component type produced by 
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the component signal converting means as picture signals of a current frame frame by frame, the non-com- 
pressed picture signals being classified into a plurality of blocks of non-compressed picture signals respectively 
corresponding to a block of the current frame; 

a DCT coefficient buffer for storing a block of DCT coefficients of luminance signals extracted from each block 
5 of DCT coefficients of the non-compressed picture signals produced by the inverted quantization means, each 

block of DCT coefficients of luminance signals corresponding to a block of the current frame, and the DCT 
coefficients of each block being arranged in a matrix of rows and columns; 

hierarchical inverted DCT processing means for repeatedly extracting a group of DCT coefficients from each 
block of DCT coefficients of luminance signals stored in the DCT coefficient buffer on condition that a frequency 
w band of the group of DCT coefficients gradually extends to a higher frequency and performing an inverted 

DCT processing for each group of DCT coefficients to produce a plurality of hierarchy pictures respectively 
indicated by a plurality of non-compressed luminance signals, the hierarchy pictures of different resolutions 
being produced for each block of the current frame; 

DCT compressing means for performing a discrete cosine transform (DCT) processing for each block of non- 
75 compressed picture signals stored in the input buffer to obtain a plurality of blocks of discrete cosine transform 
(DCT) coefficients and quantizing the DCT coefficients to obtain a plurality of blocks of quantized values; 
inverted DCT expanding means for performing an inverted DCT processing for the blocks of DCT coefficients 
obtained by the DCT compressing means to reproduce the blocks of non-compressed picture signals of the 
4:2:0 color component type; 

20 frame picture storing means for storing each block of non-compressed picture signals of the 4:2:0 color com- 

ponent type reproduced by the inverted DCT expanding means as picture signals of a block of a referential 
frame, other non-compressed picture signals of the 4:2:0 color component type corresponding to a frame 
succeeding to the referential frame being stored in the input buffer; 

motion predicting means for calculating a motion vector indicating the motion of a picture according to one 
25 block of non-compressed picture signals of the current frame stored in the input buffer and the non-compressed 

picture signals of the 4:2:0 color component type of the referential frame stored in the frame picture storing 
means for each block of the current frame and calculating an inter-frame difference between one block of non- 
compressed picture signals of the current frame and a corresponding block of non -compressed picture signals 
of the referential frame indicated by the motion vector for each block of the current frame; and 
30 coding means for coding the quantized values obtained by the DCT compressing means by using the motion 

vectors and the inter-frame differences calculated by the motion predicting means to procjuce the digital picture 
signals compressed in the second format, 
the motion predicting means comprises 

motion vector producing means for repeatedly calculating an intermediate motion vector from one hierarchy 
35 picture produced by the hierarchical inverted DCT processing means and a referential original picture of the 

referential frame indicated by non-compressed luminance signals of the non -compressed picture signals 
stored in the frame picture storing means and a rough motion vector calculated just before the calculation of 
the intermediate motion vector while changing the hierarchy picture to another hierarchy picture of a higher 
resolution for each calculation of the intermediate motion vector and setting the intermediate motion vector as 
40 the rough motion vector for each calculation of the intermediate motion vector, and finally calculating the motion 

vector from the hierarchy picture of the highest resolution and the referential original picture for each block of 
the current frame, the motion vector for a block of the current frame indicating a block of the referential frame, 
and the rough motion vector indicating candidates for a particular block of the referential frame indicated by 
the intermediate motion vector; and 
45 inter-frame difference information producing means for producing inter-frame difference information indicating 

the inter-frame difference between a group of pixel values of one block of the current frame and a group of 
pixel values of a corresponding block of the referential frame indicated by the motion vector calculated by the 
motion vector producing means for each block of the current frame. 

so 21. A picture signal converting apparatus according to claim 16 in which the picture decoding means comprises 

variable-length decoding means for performing a variable-length decoding for the digital picture signals to 
produce a plurality of quantized values; 

inverted quantization means for performing an inverted quantization for the quantized values produced by the 
55 variable-length decoding means to produce a plu rality of blocks of discrete cosine transform (DCT) coefficients 

of the non-compressed picture signals of the 4:1:1 color component type, the DCT coefficients of the non- 
compressed picture signals being classified into DCT coefficients of non -compressed luminance signals and 
DCT coefficients of non -compressed color difference signals; and 
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inverted DCT processing means for performing an inverted DCT processing for each block of DCT coefficients 
of non-compressed color difference signals produced by the inverted quantization means to produce a plurality 
of blocks of non-compressed color difference signals of the 4:1 :1 color component type, a plurality of blocks 
of non-compressed color difference signals of the 4:2:0 color component type being produced from the blocks 
5 of non-compressed color difference signals of the 4:1 : 1 color component type by the component signal con- 

verting means, 

the picture coding means comprises 

an input buffer for storing the non-compressed picture signals of the 4:2:0 color component type produced by 
the component signal converting means as picture signals of a current frame frame by frame, the non-com- 
10 pressed picture signals being classified into a plurality of blocks of non-compressed picture signals respectively 

corresponding to a block of the current frame; 

a DCT coefficient buffer for storing a block of DCT coefficients of luminance signals extracted from each block 
of DCT coefficients of the non-compressed picture signals produced by the inverted quantization means, each 
block of DCT coefficients of luminance signals corresponding to a block of the current frame, and the DCT 

*s coefficients of each block being arranged in a matrix of rows and columns; 

a one-dimensional inverted DCT processing means for extracting a block of DCT coefficients of luminance 
signals arranged in a row as an x-directional group of DCT coefficients from each block of DCT coefficients 
stored in the DCT coefficient buffer, extracting a block of DCT coefficients of luminance signals arranged in a 
column as a y-directional group of DCT coefficients from each block of DCT coefficients stored in the DCT 

20 coefficient buffer, performing an inverted DCT processing for the x-directional group of DCT coefficients to 

obtain x-directional information composed of non-compressed luminance signals arranged in the x direction 
for each block of a current frame and performing an inverted DCT processing for the y-directional group of 
DCT coefficients to obtain y-directional information composed of non-compressed luminance signals arranged 
in the y direction for each block of the current frame; 

2S DCT compressing means for performing a discrete cosine transform (DCT) processing for each block of non- 

compressed picture signals stored in the input buffer to obtain a plurality of blocks of discrete cosine transform 
(DCT) coefficients and quantizing the DCT coefficients to obtain a plurality of blocks of quantized values; 
inverted DCT expanding means for performing an inverted DCT processing for the blocks of DCT coefficients 
obtained by the DCT compressing means to reproduce the blocks of non-compressed picture signalsof the 

30 4:2:0 color component type; 

frame picture storing means for storing each block of non -compressed picture signals of the 4:2:0 color com- 
ponent type reproduced by the inverted DCT expanding means as picture signals of a block of a referential 
frame, other non -compressed picture signals of the 4:2:0 color component type corresponding to a frame 
succeeding to the referential frame being stored in the input buffer; 

35 motion predicting means for calculating a motion vector indicating the motion of a picture according to one 

block of non-compressed picture signals of the current frame stored in the input buffer and the non-compressed 
picture signals of the 4:2:0 color component type of the referential frame stored in the frame picture storing 
means for each block of the current frame and calculating an inter-frame difference between one block of non- 
compressed picture signals of the current frame and a corresponding block of non-compressed picture signals 

to of the referential frame indicated by the motion vector for each block of the current frame; and 

coding means for coding the quantized values obtained by the DCT compressing means by using the motion 
vectors and the inter-frame differences calculated by the motion predicting means to produce the digital picture 
signals compressed in the second format, 
the motion predicting means comprises 

45 motion vector producing means for calculating an x-directional motion vector according to the x-directional 

information obtained by the one-dimensional inverted DCT processing means and non-compressed luminance 
signals of the non-compressed picture signals stored in the frame picture storing means for each block of the 
current frame, specifying a plurality of remarked blocks of the referential frame arranged in the neighborhood 
of a particular block indicated by the 

50 x-directional motion vector and calculating a motion vector according to the y-directional information obtained 

by the one-dimensional inverted DCT processing means and non-compressed luminance signals of the re- 
marked blocks for each block of the current frame; and 

inter-frame difference information producing means for producing inter-frame difference information indicating 
the ihter-frame difference between a group of pixel values of one block of the current frame and a group of 
55 pixel values of a corresponding block of the referential frame indicated by the motion vector calculated by the 

motion vector producing means for each block of the current frame. 

22. A picture signal converting apparatus comprising: 
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receiving means for receiving a digital picture signal compressed in a first format for each of pixels of a frame; 
picture decoding means for decoding the digital picture signals received by the receiving means to produce 
a plurality of discrete cosine transform (DCT) coefficients of non-compressed picture signals of a 4:1:1 color 
component type, converting the DCT coefficients into a plurality of DCT coefficients of non -compressed picture 
5 signals of a 4:2:0 color component type and producing a plurality of non-compressed picture signals of the 4: 

2:0 color component type from the DCT coefficients of the non-compressed picture signals of the 4:2:0 color 
component type; 

picture coding means for coding the non-compressed picture signals of the 4:2:0 color component type ob- 
tained by the picture decoding means to produce a plurality of digital picture signals compressed in a second 
70 format different from the first format; and 

output means for outputting the digital picture signals compressed in the second format obtained by the picture 
coding means. 

23. A picture signal converting apparatus according to claim 22 in which the first format of the digital picture signals 
received by the receiving means is a DVC format, the digital picture signals compressed in the DVC format being 
obtained by performing a discrete cosine transform (DCT) processing tor each block of non-compressed picture 
signals of a 4:1 :1 color component type to obtain a block of DCT coefficients from each block of non-compressed 
picture signals, quantizing each block of DCT coefficients to obtain a block of quantized values from each block 
of DCT coefficients, coding each block of quantized values to obtain a block of variable-length codes from each 
block of quantized values and recording each block of variable-length codes as the digital picture signals com- 
pressed in the DVC format, and the second format of the digital picture signals obtained by the picture coding 
means is a moving picture experts group (MPEG) format in which a time-redundancy between frames is reduced 
by performing a motion compensation, a space-redundancy in each frame is reduced by performing a discrete 
cosine transform and a code volume is reduced by performing a variable length coding. 

24. A picture signal converting apparatus according to claim 22 in which the picture decoding means comprises 

preparing means for deshuffling the digital picture signals to rearrange the digital picture signals; 
variable-length decoding means for performing a variable-length decoding for the digital picture signals de- 
30 shuffled by the preparing means to produce a plurality of quantized values; 

inverted quantization means for performing an inverted quantization for the quantized vajues produced by the 
variable-length decoding means to produce a plurality of blocks of discrete cosine transform (DCT) coefficients 
of the non -compressed picture signals of the 4:1 :1 color component type : the DCT coefficients of each block 
being arranged in a matrix of rows and columns; 
35 DCT coefficient converting means for extracting a block of DCT coefficients of non -com pressed color difference 

signals of the 4: 1 : 1 color component type from each block of DCT coefficients of the non-compressed picture 
signals obtained by the inverted quantization means and converting each block of DCT coefficients of the non- 
compressed color difference signals of the 4:1 : 1 color component type to a block of DCT coefficients of non- 
compressed color difference signals of a 4:2:0 color component type by removing a lower half portion of DCT 
40 coefficients corresponding to higher frequency from each block of DCT coefficients to halve a resolution of 

the DCT coefficients in a y direction for each block and adding DCT coefficients on the right side of the remaining 
DCT coefficients for each block to double a resolution of the DCT coefficients in an x direction for each block; 
inverted DCT processing means for performing an inverted DCT processing for each block o! DCT coefficients 
of non-compressed luminance signals extracted from the DCT coefficients of the non -compressed picture 
45 signals obtained by the inverted quantization means and a corresponding block of DCT coefficients of the non- 

compressed color difference signals of the 4:2:0 color component type obtained by the DCT coefficient con- 
verting means to produce a plurality of blocks of non-compressed picture signals of the 4.2:0 color component 
type, and 

the picture coding means comprises 

so an input buffer for storing the blocks of non-compressed picture signals of the 4:2:0 color component type 

produced by the inverted DCT processing means as picture signals of a current frame frame by frame, each 
block of non-compressed picture signals corresponding to a block of the current frame; 
DCT compressing means for performing a discrete cosine transform (DCT) processing for each block of non- 
compressed picture signals stored in the input buffer to obtain a plurality of discrete cosine transform (DCT) 

55 coefficients for each block and quantizing the DCT coefficients to obtain a plurality of quantized values for 

each block; 

inverted DCT expanding means for performing an inverted DCT processing for the DCT coefficients obtained 
by the DCT compressing means to reproduce the blocks of non -compressed picture signals of the 4:2:0 color 
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component type; 

frame picture storing means for storing the blocks of non-compressed picture signals of the 4:2:0 color com- 
ponent type reproduced by the inverted DCT expanding means as blocks of picture signals of a referential 
frame, other non-compressed picture signals of the 4:2:0 color component type corresponding to a frame 

s succeeding to the referential frame being stored in the input buffer; 

motion predicting means for calculating a motion vector indicating the motion of a picture according to one 
block of non-compressed picture signals of the current frame stored in the input buffer and the non-compressed 
picture signals of the 4:2:0 color component type of the referential frame stored in the frame picture storing 
means for each block of the current frame and calculating an inter-frame difference according to the difference 

w between one block of non-compressed picture signals of the current frame and a corresponding block of non- 

compressed picture signals of the referential frame indicated by the motion vector; 

coding selecting means for selecting a type of coding performed for the quantized values of the current frame 
obtained by the DCT compressing means; 

variable length coding means for performing a variable length coding for the quantized values obtained by the 
75 DCT compressing means according to the coding type selected by the coding selecting means, the motion 

vectors and the inter-lrame differences calculated by the motion predicting means to produce pieces of variable 
length coded data; and 

structure coding means for producing the digital picture signals compressed in the second format from the 
variable length coded data obtained by the variable length coding means. 



20 



25. A picture signal converting apparatus according to claim 24 in which the motion predicting means comprises 



hierarchy picture producing means for producing a plurality of current hierarchy pictures of different resolutions 
from a current original picture of each block of the current frame indicated by one block of non-compressed 

25 picture signals stored in the input buffer and producing a plurality of referential hierarchy pictures from a ref- 

erential original picture of each block of the referential frame indicated by one block of non-compressed picture 
signals stored in the frame picture storing means, a current hierarchy picture of the highest resolution being 
the current original picture, a current hierarchy picture of a resolution lower than that of a specific current 
hierarchy picture being obtained each time every other pixel is removed in an x direction from pixels of the 

30 specific current original picture and every other pixel is removed in a y direction from pixels of the specific 

current original picture, a referential hierarchy picture of the highest resolution being Jhe referential original 
.picture, and a referential hierarchy picture of a resolution lower than that of a specific referential hierarchy 
picture being obtained each time every other pixel is removed in an x direction from pixels of the specific 
referential original picture and every other pixel is removed in a y directbn from pixels of the specific referential 

35 original picture; 

motion vector producing means for repeatedly calculating an intermediate motion vector from one current 
hierarchy picture and one referential hierarchy picture produced by the hierarchy picture producing means 
and a rough motion vector calculated just before the calculation of the intermediate motion vector while chang- 
ing the current and referential hierarchy pictures to other current and referential hierarchy pictures of higher 

40 resolution for each calculation of the intermediate motion vector and setting the intermediate motion vector as 

the rough motion vector for each calculation of the intermediate motion vector, and finally calculating the motion 
vector from the current and referential hierarchy pictures of the highest resolution, the motion vector being 
calculated for each block of the current frame, the motion vector for a block of the current frame indicating a 
block of the referential frame, and the rough motion vector indicating candidates for a particular block of the 

45 referential frame indicated by the intermediate motion vector; and 

inter-frame difference information producing means for producing inter-frame difference information indicating 
the inter-frame difference between a group of pixel values of one block of the current frame and a group of 
pixel values of a corresponding block of the referential frame indicated by the motion vector produced by the 
motion vector producing means for each block of the current frame. 

so 

26. A picture signal converting apparatus according to claim 24 in which the picture coding means further comprises: 

a DCT coefficient buffer for storing a block of DCT coefficients of luminance signals extracted from each block 
of DCT coefficients of the non-compressed picture signals produced by the inverted quantization means, each 
55 block of DCT coefficients of luminance signals corresponding to a block of the current frame, and the DCT 

coefficients of each block being arranged in a matrix of rows and columns; and 

hierarchical inverted DCT processing means for repeatedly extracting a group of DCT coefficients from each 
block of DCT coefficients of luminance signals stored in the DCT coefficient buffer on condition that a frequency 
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band of the group of DCT coefficients gradually extends to a higher frequency and performing an inverted 
DCT processing for each group of DCT coefficients to produce a plurality of hierarchy pictures respectively 
indicated by a plurality of non-compressed luminance signals, the hierarchy pictures of different resolutions 
being produced for each block of the current frame, and 

s the motion predicting means comprises 

motion vector producing means for repeatedly calculating an intermediate motion vector from one hierarchy 
picture produced by the hierarchical inverted DCT processing means and a referential original picture of the 
referential frame indicated by non -compressed luminance signals of the non -compressed picture signals 
stored in the frame picture storing means and a rough motion vector calculated just before the calculation of 

w the intermediate motion vector while changing the hierarchy picture to another hierarchy picture of a higher 

resolution for each calculation of the intermediate motion vector and setting the intermediate motion vector as 
the rough motion vector for each calculation of the intermediate motion vector, and finally calculating the motion 
vector from the hierarchy picture of the highest resolution and the referential original picture for each block of 
the current frame, the motion vector for a block of the current frame indicating a block of the referential frame, 

is and the rough motion vector indicating candidates for a particular block of the referential frame indicated by 

the intermediate motion vector; and 

inter-frame difference information producing means for producing inter-frame difference information indicating 
the inter-frame difference between a group of pixel values of one block of the current frame and a group of 
pixel values of a corresponding block of the referential frame indicated by the motion vector calculated by the 
20 motion vector producing means for each block of the current frame. 

27. A picture signal converting apparatus according to claim 24 in which the picture coding means further comprises: 

a DCT coefficient buffer for storing a block of DCT coefficients of luminance signals extracted from each block 
of DCT coefficients of the non-compressed picture signals produced by the inverted quantization means, each 
block of DCT coefficients of luminance signals corresponding to a block of the current frame, and the DCT 
coefficients of each block being arranged in a matrix of rows and columns; and 

a one-dimensional inverted DCT processing means for extracting a block of DCT coefficients of luminance 
signals arranged in a row as an x-directional group of DCT coefficients from each block of DCT coefficients 
stored in the DCT coefficient buffer, extracting a block of DCT coefficients of luminance signals arranged in a 
column as a y-directional group of DCT coefficients from each block of DCT coefficients stored in the DCT 
coefficient buffer, performing an inverted DCT processing for the x<Jtrectional group of DCT coefficients to 
obtain x-directional information composed of non-compressed luminance signals arranged in the x direction 
for each block of a current frame and performing an inverted DCT processing for the y<Jirectional group of 
DCT coefficients to obtain y-directional information composed of non-compressed luminance signals arranged 
in the y direction for each block of the current frame, and 
the motion predicting means comprises 

motion vector producing means for calculating an x<Jirectional motion vector according to the x-directional 
information obtained by the one-dimensional inverted DCT processing means and non-compressed luminance 
signals of the non-compressed picture signals stored in the frame picture storing means for each block of the 
current frame, specifying a plurality of remarked blocks of the referential frame arranged in the neighborhood 
of a particular block indicated by the 

x-directional motion vector and calculating a motion vector according to the y-directional information obtained 
by the one-dimensional inverted DCT processing means and non-compressed luminance signals of the re- 
marked blocks for each block of the current frame; and 

inter-frame difference information producing means for producing inter-frame difference information indicating 
the inter-frame difference between a group of pixel values of one block of the current frame and a group of 
pixel values of a corresponding block of the referential frame indicated by the motion vector calculated by the 
motion vector producing means for each block of the current frame. 

28. A picture signal converting method, comprising the steps of: 

receiving a digital picture signal compressed in a DVC format for each of pixels of a frame, the digital picture 
signals compressed in the DVC format being obtained by performing a discrete cosine transform (DCT) 
55 processing for each block of non-compressed picture signals of a 4: 1 : 1 color component type to obtain a block 

of DCT coefficients from each block of non-compressed picture signals, quantizing each block of DCT coeffi- 
cients to obtain a block of quantized values f rom each block of DCT coefficients, coding each block of quantized 
values to obtain a block of variable-length codes from each block of quantized values and recording each 
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block of variable-length codes as the digital picture signals compressed in the DVC format; 
decoding the digital picture signals to produce a plurality of non-compressed picture signals of a 4:1:1 color 
component type, the non-compressed picture signals being arranged in a matrix of rows and columns; 
removing color difference signals on every other row from the color difference signals of the non-compressed 

s picture signals to halve the number of color difference signals in a y direction; 

adding a color difference signal to a position between each pair of color difference signals adjacent to each 
other in an x direction to double the number of color difference signals in the x direction; 
setting values of the color difference signals according to values of the non-compressed picture signals of the 
4: 1 : 1 color component type to directly convert the color difference signals of the 4: 1 : 1 color component type 

10 into converted color difference signals of a 4:2:0 color component type; 

combining luminance signals of the non -compressed picture signals of the 4:1:1 color component type and 
the converted color difference signals of the 4:2:0 color component type for each pixel of the frame to produce 
non-compressed picture signals of the 4:2:0 color component type; 

coding the non-compressed picture signals of the 4:2:0 color component type to produce a plurality of digital 
75 picture signals compressed in a moving picture experts group (MPEG) format in which a time-redundancy 

between frames is reduced by performing a motion compensation, a space -redundancy in each frame is re- 
duced by performing a discrete cosine transform and a code volume is reduced by performing a variable length 
coding; and 

outputting the digital picture signals compressed in the MPEG format. 

20 

29. A picture signal converting method according to claim 28 in which the step of coding the non -com pressed picture 
signals comprises the steps of: 

storing the non-compressed picture signals of the 4:2:0 color component type in an input buffer as picture 
signals of a current frame frame by frame, the non -compressed picture signals being classified into a plurality 
of blocks of non-compressed picture signals respectively corresponding to a block of the current frame; 
performing a discrete cosine transform (DCT) processing for the blocks of non-compressed picture signals 
stored in the input buffer to obtain a plurality of blocks of discrete cosine transform (DCT) coefficients; 
quantizing the blocks of DCT coefficients to produce a plurality of quantized values of the current frame; 
performing an inverted DCT processing for each block of DCT coefficients to reproduce the blocks of non- 
compressed picture signals of the 4:2:0 color component type; 

storing the blocks of non -compressed picture signals of the 4:2:0 color component type in a frame memory 
as picture signals of a referential frame, other non-compressed picture signals of the 4:2:0 color component 
type corresponding to a frame succeeding to the referential frame being stored in the input buffer; 
calculating a motion vector indicating the motion of a picture according to one block of non-compressed picture 
signals of the current frame stored in the input buffer and the non-compressed picture signals of the 4:2:0 
color component type of the referential frame stored in the frame memory for each block of the current frame; 
calculating an inter-frame difference between one block of non-compressed picture signals of the current frame 
and a corresponding block of non-compressed picture signals of the referential frame indicated by the motion 
vector; 

selecting a type of coding performed for the quantized values of the current frame; 

performing a variable length coding for the quantized values according to the coding type, the motion vectors 
and the inter-frame differences to produce pieces of variable length coded data; and 

producing the digital picture signals compressed in the MPEG format from the variable length coded data, and 
the step of calculating a motion vector comprises the steps of 

producing a plurality of current hierarchy pictures of different resolutions from a current original picture of one 
block of the current frame indicated by one block of non-compressed picture signals stored in the input buffer 
for each block of the current frame by setting the current original picture as a current hierarchy picture of the 
highest resolution and obtaining a current hierarchy picture of a resolution lower than that of a specific current 
hierarchy picture each time every other pixel is removed in an x direction from pixels of the specific current 
original picture and every other pixel is removed in a y direction from pixels of the specific current original 
picture; 

producing a plurality of referential hierarchy pictures of different resolutions from a referential original picture 
of one block of the referential frame indicated by one block of non-compressed picture signals stored in the 
frame memory for each block of the referential frame by setting a referential hierarchy picture of the highest 
resolution as the referential original picture and obtaining a referential hierarchy picture of a resolution lower 
than that of a specific referential hierarchy picture each time every other pixel is removed in an x direction 
from pixels of the specific referential original picture and every other pixel is removed in a y direction from 
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pixels of the specific referential original picture; 

repeatedly calculating an intermediate motion vector from one current hierarchy picture and one referential 
hierarchy picture and a rough motion vector calculated just before the calculation of the intermediate motion 
vector while changing the current and referential hierarchy pictures to other current and referential hierarchy 
pictures of higher resolution; and 

finally calculating the motion vector from the current and referential hierarchy pictures of the highest resolution, 
the motion vector for a block of the current frame indicating a block of the referential frame, and the rough 
motion vector indicating candidates for a particular block of the referential frame indicated by the motion vector. 

A picture signal converting method according to claim 2B in which the step of decoding the digital picture signals 
comprises the steps of: 

performing a variable-length decoding for the digital picture signals to produce a plurality of quantized values; 
performing an inverted quantization for the quantized values to produce a plurality of blocks of discrete cosine 
transform (DCT) coefficients of the non-compressed picture signals of the 4:1:1 color component type, the 
OCT coeltictents of tne non-compressed picture signals being classified into DCT coefficients of non-com- 
pressed luminance signals and DCT coefficients of the non-compressed color difference signals; and 
performing an inverted DCT processing for each block of DCT coefficients to produce the non-compressed 
picture signals of the 4: i : 1 color component type, 

the step of coding the non-compressed picture signals comprises the steps of: 

storing each block of DCT coefficients of non-compressed luminance signals in a DCT coefficient buffer; 
storing the non-com pressed picture signals of the 4:2:0 color component type in an input buffer as picture 
signals of a current frame frame by frame, the non-compressed picture signals being classified into a plurality 
of blocks of non-compressed picture signals respectively corresponding to a block of the current frame; 
performing a discrete cosine transform (DCT) processing for each block of non-compressed picture signals 
stored in the input buffer to obtain a plurality of blocks of discrete cosine transform (DCT) coefficients; 
quantizing each block of DCT coefficients to produce a plurality of quantized values of the current frame; 
performing an inverted DCT processing for each block of DCT coefficients to reproduce the blocks of non- 
compressed picture signals of the 4:2:0 color component type; 

storing the blocks of non-compressed picture signals of the 4:2:0 color component type in a frame memory 
as picture signals of a referential frame, other non-compressed picture signals of the 4:2:0 color component 
type corresponding to a frame succeeding to the referential frame being stored in the input buffer; 
calculating a motion vector indicating the motion of a picture according to one block of non-compressed picture 
signals of one block of the current frame stored in the input buffer and the non-compressed picture signals of 
the 4:2:0 color component type of the referential frame stored in the frame memory for each block of the current 
frame; 

calculating an inter-frame difference between one blockof non-compressed picture signals of the current frame 
and a corresponding block of non-compressed picture signals of the referential frame indicated by the motion 
vector; 

selecting a type of coding performed for the quantized values of the current frame; 

performing a variable length coding for the quantized values according to the coding type, the motion vectors 
and the inter-frame differences to produce pieces of variable length coded data; and 

producing the digital picture signals compressed in the MPEG format from the variable length coded data, and 
the step of calculating a motion vector comprises the steps of: 

repeatedly extracting a group of DCT coefficients from each block of DCT coefficients of luminance signals 
stored in the DCT coefficient buffer on condition that a frequency band of the group of DCT coefficients grad- 
ually extends to a higher frequency; 

performing an inverted DCT processing for each group of DCT coefficients to produce a plurality of hierarchy 
pictures respectively indicated by a plurality of non -compressed luminance signals, the hierarchy pictures of 
different resolutions being produced for each block of DCT coefficients of luminance signals; 
repeatedly calculating an intermediate motion vector from one hierarchy picture and a referential original pic- 
ture of the referential frame indicated by non-compressed luminance signals of the non-compressed picture 
signals stored in the frame memory and a rough motion vector calculated just before the calculation of the 
intermediate motion vector while changing the hierarchy picture to another hierarchy picture of a higher res- 
olution, the rough motion vector indicating candidates for a particular block of the referential frame indicated 
by the intermediate motion vector; and 

finally calculating the motion vector from the hierarchy picture of the highest resolution and the referential 
original picture, the motion vector for a block of the current frame indicating a block of the referential frame. 
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31. A picture signal converting method according to claim 28 in which the step of decoding the digital picture signals 
comprises the steps of: 

performing a variable-length decoding for the digital picture signals to produce a plurality of quantized values; 
5 performing an inverted quantization for the quantized values to produce a plurality of blocks of discrete cosine 

transform (DCT) coefficients of the non-compressed picture signals of the 4:1 :1 color component type, each 
block of DCT coefficients of the non-compressed picture signals being classified into a block of DCT coefficients 
of non-compressed luminance signals and a block of DCT coefficients of the non-compressed color difference 
signals; and 

10 performing an inverted DCT processing for each block of DCT coefficients to produce the non-compressed 

picture signals of the 4:1:1 color component type, 

the step of coding the non-compressed picture signals comprises the steps of: 

storing each block of DCT coefficients of non-compressed luminance signals in a DCT coefficient buffer; 
storing the non-compressed picture signals of the 4:2:0 color component type in an input buffer as picture 

75 signals of a current frame frame by frame, the non-com pressed picture signals being classified into a plurality 

of blocks of non-compressed picture signals respectively corresponding to a block of the current frame; 
performing a discrete cosine transform (DCT) processing for each block of non -compressed picture signals 
stored in the input buffer to obtain a plurality of blocks of discrete cosine transform (DCT) coefficients; 
quantizing the blocks of DCT coefficients to produce a plurality of quantized values of the current frame; 

20 performing an inverted DCT processing for the blocks of DCT coefficients to reproduce the blocks of non- 

compressed picture signals of the 4:2:0 color component type; 

storing the blocks of non -compressed picture signals of the 4:2:0 color component type in a frame memory 
as picture signals of a referential frame, other non-compressed picture signals of the 4:2:0 color component 
type corresponding to a frame succeeding to the referential frame being stored in the input buffer; 

25 calculating a motion vector indicating the motion of a picture according to one block of non-compressed picture 

signals of the current frame stored in the input buffer and the non-compressed picture signals of the 4:2:0 
color component type of the referential frame stored in the frame memory for each block of the current frame; 
calculating an inter-frame difference between one block of non-compressed picture signals of the current frame 
and a corresponding block of non -com pressed picture signals of the referential frame indicated by the motion 

30 vector; 

selecting a type of coding performed for the quantized values of the current frame; 

performing a variable length coding for the quantized values according to the coding type, the motion vectors 
and the inter-frame differences to produce pieces of variable length coded data; and 

producing the digital picture signals compressed in the MPEG format from the variable length coded data, and 
3S the step of calculating a motion vector comprises the steps of: 

extracting a plurality of DCT coefficients of non-compressed luminance signals arranged in a row as an x- 
directtonal group of DCT coefficients from eachblockof DCT coefficients of non-compressed luminance signals 
stored in the DCT coefficient buffer; 

extracting a plurality of DCT coefficients of non -compressed luminance signals arranged in a column as a y- 
40 directional group of DCT coefficients from each blockof DCT coefficients of non-compressed luminance signals 

stored in the DCT coefficient buffer; 

performing an inverted DCT processing for the x-directional group of DCT coefficients to obtain x-directional 
information composed of non-compressed luminance signals arranged in the x direction for each block of a 
current frame; 

45 performing an inverted DCT processing for the y-directional group of DCT coefficients to obtain y-directional 

information composed of non -compressed luminance signals arranged in the y direction for each block of the 
current frame; 

calculating an x-directional motion vector according to the x-directional information and non-compressed lu- 
minance signals of the non-compressed picture signals stored in the frame memory for each block of the 
so current frame; 

specifying a plurality of remarked blocks of the referential frame arranged in the neighborhood of a particular 
biock of the referential frame indicated by the x-directional motion vector; and 

calculating the motion vector according to the y-directional information and non-compressed luminance signals 
of the remarked blocks for each block of the current frame. 



55 



32. A picture signal converting method, comprising the steps of: 

receiving a digital picture signal compressed in a DVC format for each of pixels of a frame, the digital picture 
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signals compressed in the DVC format being obtained by performing a discrete cosine transform (DCT) 
processing for each block of non-com pressed picture signals of a 4:1 : 1 color component type to obtain a block 
of DCT coefficients from each block of non-compressed picture signals, quantizing each block of DCT coeffi- 
cients to obtain a block of quantized values from each block of DCT coefficients, coding each block of quantized 
5 values to obtain a block of variable-length codes from each block of quantized values and recording each 

block of variable-length codes as the digital picture signals compressed in the DVC format; 
performing a variable-length decoding for the digital picture signals compressed in the DVC format to produce 
a plurality of quantized values; 

performing an inverted quantization for the quantized values to produce a plurality of blocks of discrete cosine 
io transform (DCT) coefficients of the non-compressed picture signals of the 4:1:1 color component type, each 

block of DCT coefficients of the non -compressed picture signals being classified into a block of DCT coefficients 
of non-compressed luminance signals and a block of DCT coefficients of the non-compressed color difference 
signals of the 4:1 :1 color component type; 

converting each block of DCT coefficients of the non-compressed color difference signals of the 4:1:1 color 
is component type into a block of DCT coefficients of non-compressed color difference signals of a 4:2:0 color 

component type, the DCT coefficients of each block being arranged in a matrix of rows and columns; 
combining each block of DCT coefficients of the non -compressed color difference signals of the 4:2:0 color 
component type and a corresponding block of DCT coefficients of non-compressed luminance signals to pro- 
duce a plurality of blocks of DCT coefficients of non -com pressed picture signals of the 4:2:0 color component 
20 type; 

performing an inverted DCT processing for each block of DCT coefficients of non-compressed picture signals 
of the 4:2:0 color component type to produce a block of non-compressed picture signals of the 4:2:0. color 
component type for each block of DCT coefficients; 

coding each block of non-compressed picture signals of the 4:2:0 color component type to produce a plurality 
25 of digital picture signals compressed in a moving picture experts group (MPEG) format in which a time-redun- 

dancy between frames is reduced by performing a motbn compensation, a space-redundanc y in each frame 
is reduced by performing a discrete cosine transform and a code volume is reduced by performing a variable 
length coding; and 

outputting the digital picture signals compressed in the MPEG format, and 

30 the step of converting each block of DCT coefficients comprises the steps of: 

removing a lower half portion of DCT coefficients corresponding to higher frequency from each block of DCT 
coefficients to halve a resolution of the DCT coefficients in a y direction for each block; and 
adding DCT coefficients on the right side of the remaining DCT coefficients for each block to double a resolution 
of the DCT coefficients in an x direction for each block and to produce the blocks of DCT coefficients of the 

35 non-compressed color difference signals of the 4:2:0 color component type. 

33. A picture signal converting method according to claim 32 in which the step of coding each block of non -com pressed 
picture signals comprises the steps of: 

40 storing the blocks of non-compressed picture signals of the 4:2:0 color component type in an input buffer as 

picture signals of a current frame frame by frame, each block of non-compressed picture signals corresponding 
to a block of the current frame; 

performing a discrete cosine transform (DCT) processing for each block of non-compressed picture signals 
stored in the input buffer to obtain a plurality of blocks of DCT coefficients; 
45 quantizing each block of DCT coefficients to produce a plurality of quantized values of the current frame; 

performing an inverted DCT processing for the DCT coefficients to reproduce the blocks of non -compressed 
picture signals of the 4:2:0 color component type; 

storing the blocks of non-compressed picture signals of the 4:2:0 color component type in a frame memory 
as picture signals of a referential frame, other non -compressed picture signals of the 4:2:0 color component 

50 type corresponding to a frame succeeding to the referential frame being stored in the input buffer; 

calculating a motion vector indicating the motion of a picture according to one block of non-compressed picture 
signals of the current frame stored in the input buffer and the non-compressed picture signals of the 4:2:0 
color component type of the referential frame stored in the frame memory for each block of the current frame; 
calculating an inter-frame difference according to the difference between one block of non -compressed picture 

55 signals of the current frame and a corresponding block of non-compressed picture signals of the referential 

frame indicated by the motion vector; 

selecting a type of coding performed for the quantized values of the current frame; 

performing a variable length coding for the quantized values according to the coding type, the motion vectors 
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and the inter-frame differences to produce pieces of variable length coded data; and 

producing the digital picture signals compressed in the MPEG format from the variable length coded data, and 
the step of calculating a motion vector comprises the steps of 

producing a plurality of current hierarchy pictures of different resolutions from a current original picture of one 
5 block of the current frame indicated by one block of non -compressed picture signals stored in the input buffer 

for each block of the current frame by setting the current original picture as a current hierarchy picture of the 
highest resolution and obtaining a current hierarchy picture of a resolution lower than that of a specific current 
hierarchy picture each time every other pixel is removed in an x direction from pixels of the specific current 
original picture and every other pixel is removed in a y direction from pixels of the specific current original 
10 picture: 

producing a plurality of referential hierarchy pictures of different resolutions from a referential original picture 
of one btock of the referential frame indicated by one block of non-compressed picture signals stored in the 
frame memory for each block of the referential frame by setting a referential hierarchy picture of the highest 
resolution as the referential original picture and obtaining a referential hierarchy picture of a resolution lower 
75 than that of a specific referential hierarchy picture each time every other pixel is removed in an x direction 

from pixels of the specific referential original picture and every other pixel is removed in a y direction from 
pixels of the specific referential original picture; 

repeatedly calculating an intermediate motion vector from one current hierarchy picture and one referential 
hierarchy picture and a rough motion vector calculated just before the calculation of the intermediate motion 
20 vector while changing the current and referential hierarchy pictures to other current and referential hierarchy 

pictuies of higher resolution: and 

finally calculating the motion vector from the current and referential hierarchy pictures of the highest resolution 
for each block of the current frame, the motion vector for a block of the current frame indicating a block of the 
referential frame, and the rough motion vector indicating candidates for a particular block of the referential 
25 frame indicated by the motion vector. 

34. A picture signal converting method according to claim 32 in which the step of coding each block of non-compressed 
picture signals comprises the steps of: 

storing the blocks of DCT coefficients of non-compressed luminance signals in a DCT coefficient buffer, each 
block of DCT coefficients of non-compressed luminance signals corresponding to a blook of the current frame; 
storing the blocks of non-compressed picture signals of the 4:2:0 color component type in an input buffer as 
picture signals of a current frame frame by frame; 

performing a discrete cosine transform (DCT) processing for each block of non-compressed picture signals 
stored in the input buffer to obtain a plurality of blocks of discrete cosine transform (DCT) coefficients; 
quantizing the blocks of DCT coefficients to produce a plurality of quantized values of the current frame; 
performing an inverted DCT processing for the blocks of DCT coefficients to reproduce the blocks of non- 
compressed picture signals of the 4:2:0 color component type; 

storing the blocks of non-compressed picture signals of the 4:2:0 color component type in a frame memory 
as picture signals of a referential frame, other non-compressed picture signals of the 4:2:0 color component 
type corresponding to a frame succeeding to the referential frame being stored in the input buffer; 
calculating a motion vector indicating the motion of a picture according to one block of DCT coefficients of 
non-compressed luminance signals in a DCT coefficient buffer and the non-compressed picture signals of the 
4:2:0 color component type of the referential frame stored in the frame memory for each block of the current 
frame; 

calculating an inter-frame difference between one blockof non-compressed picture signals of the current frame 
and a corresponding btock of non-compressed picture signals of the referential frame indicated by the motion 
vector; 

selecting a type of coding performed for the quantized values of the current frame; 

performing a variable length coding for the quantized values according to the coding type, the motion vectors 
and the inter-frame differences to produce pieces of variable length coded data; and 

producing the digital picture signals compressed in the MPEG format from the variable length coded data, and 
the. step of calculating a motion vector comprises the steps of: 

repeatedly extracting a group of DCT coefficients from each block of, DCT coefficients of luminance signals 
stored in the DCT coefficient buffer on condition that a frequency band of the group of DCT coefficients grad- 
ually extends to a higher frequency; 

performing an inverted DCT processing for each group of DCT coefficients to produce a plurality of hierarchy 
pictures respectively indicated by a plurality of non-compressed luminance signals, the hierarchy pictures of 
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different resolutions being produced for each block; 

repeatedly calculating an intermediate motion vector from one hierarchy picture and a referential original pic- 
ture of the referential frame indicated by non -compressed luminance signals of the non-compressed picture 
signals stored in the frame memory and a rough motion vector calculated just before the calculation of the 
intermediate motion vector while changing the hierarchy picture to another hierarchy picture of a higher res- 
olution, the rough motion vector indicating candidates for a particular block of the referential frame indicated 
by the intermediate motion vector; and 

finally calculating the motion vector from the hierarchy picture of the highest resolution and the referential 
original picture, the motion vector for a block of the current frame indicating a block of the referential frame. 

35. A picture signal converting method according to claim 32 in which the step of coding each block of non compressed 
picture signals comprises the steps of: 

storing the blocks of DCT coefficients of non -compressed luminance signals in a DCT coefficient buffer, each 
is block of DCT coefficients of non-compressed luminance signals corresponding to a block of the current frame; 

storing the blocks of non-compressed picture signals of the 4:2:0 color component type in an input buffer as 
picture signals of a current frame frame by frame; 

performing a discrete cosine transform (DCT) processing for each block of non-compressed picture signals 
stored in the input buffer to obtain a plurality of blocks of discrete cosine transform (DCT) coefficients; 
20 quantizing the blocks of DCT coefficients to produce a plurality of quantized values of the current frame; 

performing an inverted DCT processing for the blocks of DCT coefficients to reproduce the blocks of non- 
compressed picture signals of the 4:2:0 color component type; 

storing the blocks of non-compressed picture signals of the 4:2:0 color component type in a frame memory 
as picture signals of a referential frame, other non-compressed picture signals of the 4:2:0 color component 
25 type corresponding to a frame succeeding to the referential frame being stored in the input buffer; 

calculating a motion vector indicating the motion of a picture according to one block of DCT coefficients of 
non-compressed luminance signals in the DCT coefficient buffer and the non-compressed picture signals of 
the 4:2:0 color component type of the referential frame stored in the frame memory for each block of the current 
frame; 

30 calculating an inter-frame difference between one block of non-compressed picture signals of the current frame 

and a corresponding block of non-compressed picture signals of the referential frame indicated by the motion 
vector; 

selecting a type of coding performed for the quantized values of the current frame: 

performing a variable length coding for the quantized values according to the coding type, the motion vectors 
35 and the inter-frame differences to produce pieces of variable length coded data; and 

producing the digital picture signals compressed in the MPEG format from the variable length coded data, and 
the step of calculating a motion vector comprises the steps of: 

extracting a plurality of DCT coefficients of non-compressed luminance signals arranged in a row as an x- 
directional group of DCT coefficients from each blockof DCT coefficients of non-compressed luminance signals 
40 stored in the DCT coefficient buffer; 

extracting a plurality of DCT coefficients of non -compressed luminance signals arranged in a column as a y- 
directional group of DCT coefficients from each blockof DCT coefficients of non-compressed luminance signals 
stored in the DCT coefficient buffer; 

performing a one-dimensional inverted DCT processing for the x-directional group of DCT coefficients to obtain 
45 x-directional information composed of non-compressed luminance signals arranged in the x direction for each 

block of the current frame; 

performing a one-dimensional inverted DCT processing for the y-directional group of DCT coefficients to obtain 
y-direclional inlormation composed of non-compressed luminance signals arranged in the y direction for each 
block of the current frame; 

50 calculating an x-directional motion vector according to the x-directional information and non-compressed lu- 

minance signals of the non -com pressed picture signals stored in the frame memory for each block of the 
current frame; 

specifying a plurality of remarked blocks of referential frame arranged in the neighborhood of a particular block 
of the referential frame indicated by the x-directional motion vector; and 
55 calculating the motion vector according to the y-directional information and non-compressed luminance signals 

of the remarked blocks for each block of the current frame. 

36. A picture providing system, comprising: 
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picture input means for receiving a plurality of digital picture signals compressed in a first format; 

picture reproducing means for reproducing a digital picture according to a plurality of digital picture signals 

compressed in a second format different from the first format; 

picture providing means for receiving the digital picture signals compressed in the first format from the picture 
5 input means, converting the digital picture signals compressed in the first format into the digital picture signals 

compressed in the second format and transmitting the digital picture signals compressed in the second format 
to the picture reproducing means; and 

a network through which the digital picture signals compressed in the first format is transmitted from the picture 
input means to the picture providing means and the digital picture signals compressed in the second format 
70 is transmitted from the picture providing means to the picture reproducing means, 

the picture providing means comprising: 

communicating means for receiving the digital picture signals compressed in the first format from the picture 
input means through the network and outputting the digital picture signals compressed in the second format 
to the picture reproducing means through the network; and 
75 picture signal converting means for converting the digital picture signals of the first format received by the 

communicating means into the digital picture signals compressed in the second format and outputting the 
digital picture signals compressed in the second format to the communicating means, and 
the picture signal converting means comprising 

picture decoding means for decoding the digital picture signals compressed in the first format to produce a 
20 plurality of non-compressed picture signals of a 4:1:1 color component type, the non-compressed picture 

signals being arranged in a matrix of rows and columns; 

component signal converting means for directly converting color difference signals of the non-compressed 
picture signals obtained by the picture decoding means into converted color difference signals of a 4:2:0 color 
component type by removing color difference signals on every other row from the color difference signals of 

25 the non-compressed picture signals to halve the number of color difference signals in a y direction and adding 

a color difference signal to a position between each pair of color difference signals adjacent to each other in 
an x direction to double the number of color difference signals in the x direction, setting values of the converted 
color difference signals of the 4:2:0 color component type according to values of the color difference signals 
of the non-compressed picture signals obtained by the picture decoding means and combining luminance 

30 signals of the non-compressed picture signals obtained by the picture decoding means and the converted 

color difference signals of the 4:2:0 color component type obtained by the color difference signal converting 
means for each pixel of the frame to produce non-compressed picture signals of the 4:2:0 color component 
type; and 

picture coding means for coding the non-compressed picture signals of the 4:2:0 color component type ob- 
35 tained by the component signal converting means to produce the digital picture signals compressed in the 

second format. 

37. A picture providing system according to claim 36 in which the first format of the digital picture signals received by 
the picture input means is a DVC format, the digital picture signals compressed in the D VC format being obtained 

40 by performing a discrete cosine transform (DCT) processing for each block of non-compressed picture signals of 

a 4:1 :1 color component type to obtain a block of DCT coefficients from each block of non-compressed picture 
signals, quantizing each block of DCT coefficients to obtain a block of quantized values from each block of DCT 
coefficients, coding each block of quantized values to obtain a block of variable-length codes from each block of 
quantized values and recording each block of variable-length codes as the digital picture signals compressed in 

45 the DVC lormat, and the second format of the digital picture signals obtained by the picture signal converting 

means is a moving picture experts group (MPEG) format in which a time-redundancy between frames is reduced 
by performing a motion compensation, a space-redundancy in each frame is reduced by performing a discrete 
cosine transform and a code volume is reduced by performing a variable length coding. 

so 38. a picture providing system according to claim 36 in which the picture reproducing means further comprises 

picture signal storing means for storing the digital picture signals of the first format received by the communi- 
cating means and the digital picture signals of the second format obtained by the picture signal converting 
means; 

55 control means for receiving a picture output request indicating a request of the output of digital picture signals 

of the second format from the picture reproducing means through the network and the communicating means, 
controlling the picture signal storing means and the communicating means to output the digital picture signals 
of the second format stored in the picture signal storing means to the picture reproducing means through the 
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communicating means and the network 

39. A picture providing system according to claim 36 in which the picture reproducing means further comprises 

control means for receiving a picture output request indicating a request of the output of digital picture signals 
5 of the second format from the picture reproducing means through the network and the communicating means, 

controlling the picture signal converting means to convert the digital picture signals compressed in the first format 
into the digital picture signals compressed in the second format according to the picture output request and con- 
trolling the communicating means to output the digital picture signals compressed in the second format to the 
picture reproducing means through the network. 

10 

40. A picture providing system, comprising: 

picture input means for receiving a plurality of digital picture signals compressed in a first format; 

picture reproducing means for reproducing a digital picture according to a plurality of digital picture signals 

1$ compressed in a second format different from the first format; 

picture providing means for receiving the digital picture signals compressed in the first format from the picture 
input means, converting the digital picture signals compressed in the first lormat into the digital picture signals 
compressed in the second format and transmitting the digital picture signals compressed in the second format 
to the picture reproducing means; and 

20 a network through which the digital picture signals compressed in the first format is transmitted from the picture 

input means to the picture providing means and the digital picture signals compressed in the second format 
is transmitted from the picture providing means to the picture reproducing means, 
the picture providing means comprising: 

communicating means for receiving the digital picture signals compressed in the first format from the picture 
25 input means through the network and outputting the digital picture signals compressed in the second format 

to the picture reproducing means through the network; and 

picture signal converting means for converting the digital picture signals of the first format received by the 
communicating means into the digital picture signals compressed in the second format and outputting the 
digital picture signals compressed in the second format to the communicating means, and 

30 the picture signal converting means comprising 

picture decoding means for decoding the digital picture signals of the first format to produce a plurality of 
discrete cosine transform (DCT) coefficients of non-compressed picture signals of a 4:1:1 color component 
type, converting the DCT coefficients into a plurality of DCT coefficients of non-compressed picture signals of 
a 4:2:0 color component type and producing a plurality of non -compressed picture signals of the 4:2:0 color 

35 component type from the DCT coefficients of the non-compressed picture signals of the 4:2:0 color component 

type; and 

picture coding means for coding the non-compressed picture signals of the 4:2:0 color component type ob- 
tained by the picture decoding means to produce the digital picture signals compressed in the second format. 

40 41 . A picture providing system according to claim 40 in which the first format of the digital picture signals received by 
the picture input means is a DVC format, the digital picture signals compressed in the DVC format being obtained 
by performing a discrete cosine transform (DCT) processing for each block of non-compressed picture signals of 
a 4:1:1 color component type to obtain a block of DCT coefficients from each block of non-com pressed picture 
signals, quantizing each block of DCT coefficients to obtain a block of quantized values from each block of DCT 

45 coefficients, coding each block of quantized values to obtain a block of variable-length codes from each block of 

quantized values and recording each block of variable-length codes as the digital picture signals compressed in 
the DVC format, and the second formal of the digital picture signals obtained by the picture signal converting 
means is a moving picture experts group (MPEG) format in which a time-redundancy between frames is reduced 
by perlorming a motion compensation, a space-redundancy in each frame is reduced by performing a discrete 

so cosine transform and a code volume is reduced by performing a variable length coding. 

42. A picture providing system according to claim 40 in which the picture decoding means of the picture signal con- 
verting means comprises 

55 preparing means for deshuffling the digital picture signals to rearrange the digital picture signals; 

variable-length decoding means for performing a variable-length decoding for the digital picture signals de- 
shuffled by the preparing means to produce a plurality of quantized values; 

inverted quantization means for performing an inverted quantization for the quantized values produced by the 
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variable-length decoding means to produce a plurality of blocks of discrete cosine transform (DCT) coefficients 
of the non -compressed picture signals of the 4:1:1 color component type : the DCT coefficients of each block 
being arranged in a matrix of rows and columns; 

DCT coefficient converting means for extracting a block of DCT coefficients of non-compressed color difference 
signals of the 4: 1 : 1 color component type from each block of DCT coefficients of the non-compressed picture 
signals obtained by the inverted quantization means and converting each block of DCT coefficients of the non- 
compressed color difference signals of the 4:1 :1 color component type to a block of DCT coefficients of non- 
compressed color difference signals of a 4:2:0 color component type by removing a lower half portion of DCT 
coefficients corresponding to higher frequency from each block of DCT coefficients to halve a resolution of 
the DCT coefficients in a y direction for each block and adding DCT coefficients on the right side of the remaining 
DCT coefficients for each block to double a resolution of the DCT coefficients in an x direction for each block; 
and 

inverted DCT processing means for performing an inverted DCT processing for each block of DCT coefficients 
of non-compressed luminance signals extracted from the DCT coefficients of the non -compressed picture 
signals obtained by the inverted quantization means and a corresponding block of DCT coefficients of the non- 
compressed color difference signals of the 4:2:0 color component type obtained by the DCT coefficient con- 
verting means to produce the non-compressed picture signals of the 4:2:0 color component type. 

43. A picture providing system according to claim 40 in which the picture reproducing means further comprises 

20 

picture signal storing means for storing the digital picture signals of the first format received by the communi- 
cating means and the digital picture signals of the second format obtained by the picture signal converting 
means; 

control means for receiving a picture output request indicating a request of the output of digital picture signals 
zs of the second format from the picture reproducing means through the network and the communicating means, 

controlling the picture signal storing means and the communicating means to output the digital picture signals 
of the second format stored in the picture signal storing means to the picture reproducing means through the 
communicating means and the network 

30 44. A picture providing system according to claim 40 in which the picture reproducing means further comprises 

control means for receiving a picture output request indicating a request of the output of digital picture signals 
of the second format from the picture reproducing means through the network and the communicating means, 
controlling the picture signal converting means to convert the digital picture signals compressed in the first 
35 format into the digital picture signals compressed in the second format according to the picture output request 

and controlling the communicating means to output the digital picture signals compressed in the second format 
to the picture reproducing means through the network. 

40 



45 



SO 



55 



72 

BNSDOCID: <EP 0862339A2J_> 



10 



EP 0 862 339 A2 



Cr Cb 



FIG. I A v 
PRIOR ART L^J L^l L^J 



ONE PIXEL ONE PIXEL ONE PIXEL 



FIG. IB 
PRIOR ART 



FOR 

ONE FRAME 




FOR 

ONE FRAME 




FOR 

ONE FRAME 




BNSDOCID: <EP OS62339A2_L: 



73 



EP 0 862 339 A2 



FIG. 2 A 
PRIOR ART 



ONE PIXEL 



g g 

ONE PIXEL ONE PIXEL 



ONE PIXEL 



FIG. 2B 
PRIOR ART 



FOR 

ONE FRAME 






FOR ONE FRAME FOR ONE FRAME 



BNSDOCID: <EP 0862339A2_L> 



74 



EP 0 862 339 A2 



FIG. 3 A 
PRIOR ART 



ONE PIXEL 



ONE PIXEL 




ONE PIXEL 



ONE PIXEL 



ONE PIXEL ONE PIXEL 



FIG. 38 
PRIOR ART 



FOR _j 
ONE FRAME 






FOR ONE FRAME FOR ONE FRAME 



BNSOOCID: <EP 08S233QA2 I > 



75 



EP 0 862 339 A2 



FIG. 4 A 
PRIOR ART 



ONE PIXEL v ONE PIXEL 



ONE 
PIXEL' 



3, 



ONE PIXEL ONE PIXEL 



ONE 
PIXEL 



FIG. 4B r 
PRIOR ART \ 



FOR 

ONE FRAME 





FOR ONE FRAME FOR ONE FRAME 



RNSnOOlD: <EP 0862339A2 I > 



76 



EP 0 862 339 A2 



FIG. 5 
PRIOR ART 



01 



ANALOG VIDEO 
APPARATUS 



ANALOG 

PICTURE 

SIGNAL 

/ - 



4:4:4 TYPE 
4:2:2 TYPE 



103 



DIGITAL VIDEO 
APPARATUS 



(4:1:1 TYPE) 



102 



ANALOG-TO-DIGITAL 
CONVERTER 



104 



MPEG 
ENCODER 



4:2:0 TYPE 



4:4:4 TYPE 
4:2:2 TYPE 



MPEG DATA 



NON- COMPRESSED 
DIGITAL PICTURE SIGNAL 



77 



BNSDOCID: <EP 0862339A2_L> 



EP 0 862 339 A2 



FIG. 6 



12 



^ 

INPUT 
UNIT 



13 



Y FRAME 
MEMORY 



XL 



.14 



INPUT Cr 
FRAME MEMORY 



XL 



15 



INPUT Cb 
FRAME MEMORY 



.1 



.11 



CL 

OUTPUT 
UNIT 
r— ■ 



XL 



.16 



COLOR 

DIFFERENCE 
SIGNAL 
CONVERTING 
UNIT 



XL 



17 



OUTPUT Cr 
FRAME MEMORY 



XL 



.18 



OUTPUT Cb 
FRAME MEMORY 



FIG. 7 

( START ~) 



RECEPTION OF 4:1.1 TYPE COMPONENT 
PICTURE SIGNALS 



CONVERSION OF COLOR DIFFERENCE SIGNALS 



-SI 0 1 



-SI 02 



OUTPUT OF 4:2:0 TYPE COMPONENT PICTURE SIGNALS 



ox 



SI 03 




SI 04 



78 



EP 0 862 339 A2 



FIG. 8A 



YO. 0 


Yl. 0 


Y2.0 


Y3. 0 


Y4. 0 


Y5. 0 


Y6. 0 


Y7. 0 


YO. 1 


Yl. 1 


Y2. 1 


Y3. 1 


Y4. 1 


Y5. 1 


Y6. 1 


Y7. 1 


YO. 2 


Yl. 2 


Y2.2 


Y3. 2 


Y4. 2 


Y5. 2 


Y6. 2 


Y7. 2 


YO. 3 


Yl. 3 


Y2.3 


Y3.3 


Y4. 3 


Y5. 3 


Y6. 3 


Y7.3 



FIG. 8B 



U'O. 0 


in. o 


U'O. 1 


U'l. 1 


U'O. 2 


in. 2 


U'O. 3 


U'l. 3 



FIG. 8D 



U 2 0.0 


U 2 1.0 


U 2 2.0 


U 2 3. 0 


U 2 o. l 


U 2 1. 1 


U 2 2. 1 


U 2 3. 1 



FIG. 8C 



V'0.0 


V'1.0 


V'O. 1 


V'l. 1 


V'O. 2 


V'1.2 


V'O. 3 


V'l. 3 



FIG. 8E 



v 2 o. o 


V 2 1. 0 


V 2 2. 0 


V 2 3. 0 


v 2 o. i 


V 2 l. 1 


V 2 2. 1 


V 2 3. 1 



79 



EP 0 862 339 A2 



FIG. 9 A 

16 

f 

ONAL k 16a I X-D! RECTI 01 





Y-DI RECTI ONAL 
SIGNAL 
HALVING UNIT 


^16a 


X-D 1 RECTI ONAL 
SIGNAL 

DOUBLING UNIT 


^1 6b 




» 


> 



FIG. 9B 

16 



» 


SIGNAL VALUE 


^16c 


Y-DI RECTI ONAL 
SIGNAL 

HALVING UNIT 


^.16a 


X- DIRECTIONAL 
S 1 GNAL 

DOUBLING UNIT 


^1 6b 




SETTING UNIT 









FIG. 9C 

16 



* 


SIGNAL VALUE 
SETTING UNIT 


^16c 
» 


Y-DI RECTI ONAL 
SIGNAL 
HALVING UNIT 


^16a 


X-DI RECTIONAL 
SIGNAL 

DOUBLING UNIT 


^16d 











AVERAGE 
VALUE 

CALCULATING 
UNIT 



FIG. 9D 



16 



INTERPLATED 
VALUE 

CALCULATING 
UNIT 



16e 



SIGNAL 
VALUE 
SETTING 
UNIT 



16f 



16g 



DIRECTIONAL 
SIGNAL 
HALVING 
UNIT 





X- 

DIRECT 
SIGNAL 
DOUBLING 
UNIT 



ONAL 



16a 



16h 



BNSDOCID: <EP 0862339A2_I_> 



80 



EP 0 862 339 A2 



FIG. 11 A 



FIG. 10A 



YO. 0 


Yl.O 


Y2. 0 


Y3.0 


Y4. 0 


Y5. 0 


Y6.0 


Y7.0 


YO. J 


Yl. 1 


Y2. 1 


Y3. 1 


Y4. 1 


Y5. 1 


Y6. 1 


Y7. 1 



FIG. 10B 



U'O. 0 


U'1. 0 


U'2. 0 


U'3. 0 


u'o. 1 


UM. 1 


U'2. 1 


U'3. 1 



V'O. 0 


V'l. 0 


V'2.0 


V'3. 0 


V'O. 1 


V'l. 1 


V'2. 1 


V'3. 1 



0 


100 


100 


0 


100 


0 


0 


0 



FIG. 11 B 



0 


0 


100 


100 


100 


100 


0 


0 



FIG. 11 C 



50 


50 


50 


50 


50 


50 


0 


0 



FIG. IOC 



U'O. 0 


U'2. 0 


U'O. 1 


U'2. 1 



V'O. 0 


V'2.0 


V'O. 1 


V'2. 1 



FIG. 11D 



50 


50 


50 




50 


25 


0 





FIG. HE 



50 


50 






38 


13 







81 



BNSDOCID: <EP 0B62339A2J_> 



FIG. 12A 



0 


100 


200 


0 


100 


0 


0 


0 



FIG. 12 B 



0 


0 


100 


100 


100 


100 


0 


0 



FIG. 12C 



100 


100 


50 


50 


50 


50 


0 


0 



FIG. 12D 



100 


75 


50 




50 


25 


0 





FIG. 12E 



88 


63 






38 


13 







FIG. 13A 



0 


100 


80 


150 


160 


200 


240 


250 



FIG. 13B 



0 


0 


100 


100 


160 


160 


200 


200 



FIG. 13C 



40 


40 


125 


125 


200 


200 


225 


225 



FIG. 13D 



40 


83 


125 




200 


213 


225 





FIG. 13E 



61 


104 






206 


219 







EP 0 862 339 A2 



FIG. 14 



12 



^ 

INPUT 
UNIT 



13 





Y FRAME 
MEMORY 



21 



.22 



REFERENTIAL LUMINANCE 
SIGNAL EXTRACTING UNIT 



14 



. INPUT Cr 
^ FRAME MEMORY 



.15 



INPUT Cb 
FRAME MEMORY 



23 



COLOR 

DIFFERENCE 
SIGNAL 
CONVERTING 
UNIT 



CL 

OUTPUT 
UNIT 



.19 



CL 

OUTPUT Cr 
FRAME MEMORY 



17 



18 



OUTPUT Cb 
FRAME MEMORY 



FIG. 15 



( START ) 



RECEPTION OF 4:1:1 TYPE COMPONENT 
PICTURE SIGNALS 



CONVERSION OF COLOR DIFFERENCE SIGNALS 



-SI 01 



r 



S201 



OUTPUT OF 4:2:0 TYPE COMPONENT PICTURE SIGNALS 



-SI 03 




SI 04 



QB62339A2J _> 



83 



EP 0 862 339 A2 



FIG. 16A 



AVERAGE VALUE 

CALCULATING 

UNIT 


— » 


WEIGHTING FACTOR 
CALCULATING UNIT 


— * 


INTERPOLATED 
VALUE 

CALCULATING 
UNIT 















23d 



16a 



23e 



* 


SIGNAL VALUE 
SETTING UNIT 


— » 


Y-DIRECTIONAL 
SIGNAL 
HALVING UNIT 




X-DIRECTIONAL 
SIGNAL 

DOUBLING UNIT 








— » 


>■ 



FIG. 16B 

,23f » 23g 23h 





WEIGHTING 




INTERPOLATED 




SIGNAL 






FACTOR 


► 


VALUE 




VALUE 






CALCULATING 




CALCULATING 


► 


SETT I NG 






UNIT 




UNIT 




UNIT 





16a 



23 i 





Y-DIRECTIONAL 
SIGNAL 
HALVING UNIT 




X-DIRECTIONAL 
SIGNAL 

DOUBLING UNIT 






¥ 


► 



BNSDOCID: <EP 0862339A2J„> 



84 



EP 0 862 339 A2 



FIG. 17A 



200 


200 


100 


100 


100 


100 


100 


100 


200 


200 


!00 


100 


100 


100 


100 


100 



FIG. 17 B 



0 


200 


0 


200 



FIG. 17C 



0 


200 


200 





FIG. I7D 



40 


160 







FIG. 17E 



200 



200| 



85 



BNSDOCIO <EP_0862339A2J_> 



EP 0 862 339 A2 



FIG. 18 



.31 







INPUT UNIT y 



36 



37- 



OUTPUT UNIT 

A 







PREPARING 
UNIT 



38 



VARIABLE 
LENGTH 
DECODING 
«o 4 "NIT 



INVERTED 

QUANTIZATION 

UNIT 


> 


INVERTED 
DCT 

PROCESSING 
UNIT 


* 







34. 

(11 OR 21) ^ 



,41 



COMPONENT 
SIGNAL 
CONVERTING 
UNIT 



-£1 



35 



INPUT 
BUFFER 



43 



CODING 

CONTROL UNIT 



DCT 

COMPRESSING 



r* UNIT 



S 



44 



45 



INVERTED 
DCT 

EXPANDING 
UNI 



46 



g FRAME 
MEMORY 



47 



MOTION 

PREDICTING 

UNIT 



42 



CODE 

SELECTING 



r* UNIT 



48 



49 



t / 



VARIABLE 
LENGTH 
CODING 
UNIT 



50 



STRUCTURE 

CODING 

UNIT 



86 



BNSDOCID: <EP 0862339A2 I > 



EP 0 862 339 A2 



FIG. 19 

( START ^) 



S301 



DECODING OF DIGITAL 
COMPRESSED PICTURE 
SIGNALS 






S302 


CONVERSION OF 
NON-COMPRESSED 4:1:1 TYPE 
COMPONENT PICTURE SIGNALS 






S303 


CODING OF NO 
4:2:0 TYPE C 
PICTURE SIGN 


N-COMPRESSED 

OMPONENT 

ALS 





( E " p ) 



FIG. 20 



( START ^ 



1 


S311 


DESHUFFLING OF DIGITAL 
COMPRESSED PICTURE SIGNALS 






S312 


VARIABLE LENGTH DECODING 
FOR DIGITAL COMPRESSED 
PICTURE SIGNALS 






S313 


INVERTED QUANTIZATION 
FOR VARIABLE LENGTH 
DECODED INFORMATION 






S314 


INVERTED DC1 
FOR DCT COEF 


r PROCESSING 
TICIENT 





( ) 



BNSDOCID: <EP 0862339A2_L> 



87 



EP 0 862 339 A2 



FIG. 21 



START 



S3 21 



DCT PROCESSING FOR NON-COMPRESSED 4:2:0 TYPE COMPONENT! 
PICTURE SIGNALS AND QUANTIZATION OF DCT COEFFICIENT 




I -PICTURE 



S326 



B-PICTURE 
P- PICTURE 



1 



XL 



S323 



MOTION PREDICTING PROCESSING 



INVERTED DCT PROCESSING 
FOR DCT COEFFICIENTS 



XL 



S324 



INVERTED DCT PROCESSING 
FOR DCT COEFFICIENTS 



XL 



S3 2 5 



SELECTION OF CODING METHOD 



* * x < 

VARIABLE LENGTH CODING f 



S327 



STRUCTURE CODING FOR 
VARIABLE LENGTH CODES 



-S328 



88 



BNSDOCID: <EP 0862339A2 I > 



EP 0 862 339 A2 



FIG. 22 

ORIGINAL PICTURE 




DOWN-SAMPLING 



1/2-RES0LUTI0N PICTURE 




1/4-RES0LUTI0N PICTURE 




1/8-RESOLUTION PICTURE 




89 



EP 0 862 339 A2 



FIG. 23 



FROM 

INPUT 

BUFFER 



FROM 

FRAME 

MEMORY 



47 



.51 



HIERARCHY 
PICTURE L 
PRODUCING 
UNIT 



.52 



INTER- FRAME DIFFERENCE 
INFORMATION PRODUCING UNIT 
— ar 



56 



H I ERARCHY 

PICTURE 

MEMORY 



.53 



MOTION 
VECTOR 
CALCULATING 
UNIT 

1 



54 



55 



MOTION 
VECTOR 
PRODUCING 
UNIT 



ROUGH MOTION VECTOR 
STORING UNIT 



TO CODE 

SELECTING 

UNIT 



FIG. 24 



c 



START 



XL 



S331 



PRODUCTION OF HIERARCHY PICTURES 



] 



S332 



CALCULATION OF INTERMEDIATE MOTION VECTORS | 



S333 



PRODUCTION OF MOTION VECTORS 



] 



S334 



PRODUCTION OF INTER-FRAME DIFFERENCE INFORMATION | 



c 



END 



3 



90 



EP 0 862 339 A2 



FIG. 25 A 



REMARKED CURRENT MACROBLOCK 
CURRENT J- V8-RES0LUTI0N PICTURE 

FRAME 




-INTERMEDIATE MOTION VECTOR 



REFERENTIAL 
FRAME 




PARTICULAR REFERENTIAL MACROBLOCK 



FIG. 25 B 



ROUGH 
MOTION 
VECTOR 



REMARKED CURRENT MACROBLOCK 

1 A- RESOLUTION PICTURE 

CURRENT FRAME 



INTERMEDIATE MOTION VECTOR 





REFERENTIAL FRAME 



PARTICULAR REFERENTIAL 
MACROBLOCK 

REFERENTIAL MACROBLOCK CANDIDATES 
SPECIFIC REFERENTIAL MACROBLOCK 



91 



BP 0 862 339 A2 



FIG. 26 



INPUT UNIT 



36 



f 32 



37- 



OUTPUT UNIT 



.£1 



.33 



PREPARING 
UNIT 



38 



39 



VARIABLE 
LENGTH 
DECODING 
UNIT 



INVERTED 

QUANTIZATION 

UNIT 



40 



INVERTED 
DCT 

PROCESSING 
UNIT 



41 



COMPONENT 
SIGNAL 
CONVERTING 
UNIT 



34 



DCT 




COEFFICIENT 


BUFFER 





63 







.62 



INPUT / 
BUFFER 



43 



CODING 

CONTROL UNIT 



U DCT 



XL 



64 



HIERARCHICAL 
INVERTED DCT 
PROCESSING 
UNIT 



I 



COMPRESSING 



r* UNIT 



44 



45 



XI INVERTED 
DCT 

EXPANDING 
UNIT 



46 



FRAME 
MEMORY 



xL 



65 



MOTION 

PREDICTING 

UNIT 



42 



CODE 

SELECTING 



r* UNIT 



48 



XL 



.49 



VARIABLE 
LENGTH 
CODING 
UNIT 



XL 



50 



STRUCTURE 

CODING 

UNIT 



92 



EP 0 862 339 A2 



FIG. 27 



FROM 

HIERARCHY 
INVERTED DCT 
PROCESSING 
UNIT 



FROM 
FRAME 



MEMORY 



52 



.65 



53, 



INTER -FRAME 
INFORMATION 



HIERARCHY 
II PICTURE 
MEMORY 



MOTION 
VECTOR 
CALCULATING 
UNIT 



I 



DIFFERENCE 
PRODUCING UNIT 

I=Z 



56 



MOTION 
VECTOR 
PRODUCING 
UNIT 



55 



ROUGH MOTION 
STORING UNIT 



VECTOR 



54 



U V 



TO CODE 

SELECTING 

UNIT 



FIG. 28 



$311 



S3 12- 



S313 



( START ) 



DESHUFFLING OF DIGITAL COMPRESSED PICTURE SIGNALS] 

1 ' 



VARIABLE LENGTH DECODING FOR DIGITAL 
COMPRESSED PIC TURE SIGNALS 



INVERTED QUANTIZATION FOR VARIABLE 
LENGTH DECODED INFORMATION 



LUMINANCE SIGNAL 



S316 



STORAGE OF DCT COEFFICIENTS IN 
DCT COEF FICIENT BUFFER 63 

1 




S3 15 COLOR DIFFERENCE 
SIGNAL 



S3 17 



INVERTED DCT PROCESSING 
FOR DCT COEFFICIENTS 

l 



c 



END 



BNSDOCID <EP 0862339A2J > 



93 



EP 0 862 339 A2 



FIG. 29 




S342 



DCT PROCESSING 
I 



B- PICTURE 
P- PICTURE 



S344 



QUANTIZATION OF 
DCT COEFFICIENTS 



S345 



S346 



HIERARCHICAL INVERTED DCT 
PROCESSING FOR DCT 
COEFFICIENTS 



INVERTED DCT PROCESSING 
FOR DCT COEFFICIENTS 



S347. 



MOTION PREDICTION 



INVERTED DCT PROCESSING 
FOR DCT COEFFICIENTS 



SELECTION OF CODING METHOD 



1 



VARIABLE LENGTH CODING \ ^ 



I 



STRUCTURE CODING FOR 
VARIABLE LENGTH CODES 



-S348 

-S349 

S327 
S328 



c 



END 



94 



EP 0 862 339 A2 



FIG. 30A 



DIRECT CURRENT COMPONENT 

BLOCK OF DCT COEFFICIENTS 



LOWER 
FREQUENCY 



HIGHER 
FREQUENCY 



INVERTED DCT 

.PROCESSING 1/8-RESOLUTION PICTURE 



-HIGHEST FREQUENCY COMPONENT 



FIG. 30B 



PROCESSING 01 1/4-RES0 LUTI0N PICTURE 




FIG. 30C 



1/2-RES0LUTI0N 







INVERTED DCT 
PROCESSING 











































































































PICTURE 



FIG. 30D 



ORIGINAL PICTURE 




INVERTED DCT 
PROCESSING 




95 

BNSOOCia <EP_0862339A2_I_> 



EP 0 862 339 A2 



FIG. 31 



A BLOCK OF DCT 



COEFFIC 



ENTS 



1/8-RES0LUTI0N PICTURE 



1/4-RES0LUTI0N PICTURE 



o 




EP 0 862 339 A2 



FIG. 32 



71 



INPUT UNIT 



.36 



37- 



OUTPUT UNIT j 



.33 



38 



PREPARING 
UNIT 
^7 



39 



VARIABLE 
LENGTH 
DECODING 
UNIT 



INVERTED 

QUANTIZATION 

UNIT 



40 



INVERTED < 
DCT 

PROCESSING 
UNIT 



41 



COMPONENT < 
SIGNAL 
CONVERTING 
UNIT 



T 



34 



DCT 




COEFFICIENT 


BUFFER 





63 



72 



INPUT \$ 
BUFFER 



43 



CODING 

CONTROL UNIT 



T 



73 



ONE- 
DIMENSIONAL 
INVERTED DCT 
PROCESSING 
UNIT 



DCT V 
COMPRESSING 
UNIT 



44 



n 



45 



INVERTED 
DCT 

EXPANDING 
UNI 



46 ^J7rame 



MEMORY 



74 



MOTION 

PREDICTING 

UNIT 



42 



CODE 

SELECTING 



r* UNIT 



.48 



49 



VARIABLE 
LENGTH 
CODING 
UNIT 



50 



STRUCTURE 
COD I NG 
UNIT 



97 

BNSOOCIO: <EP_0662339A2J_> 



EP 0 862 339 A2 



FIG. 33 



56 



74 



FROM 

FRAME MEMORY 



^ 

INTER- FRAME DIFFERENCE 

INFORMATION PRODUCING UNIT 
i 



FROM 
ONE- 
DIMENSIONAL 
INVERTED DCT 
PROCESSING 
UNIT 



.53 



MOTION VECTOR 
CALCULATING UNIT 



55 



MOTION VECTOR L 
PRODUCING UNIT 



54 



ROUGH MOTION VECTOR 
STORING UNIT 



II 



TO CODE 

SELECTING 

UNIT 



0862339A2 I > 



98 



EP 0 862 339 A2 



FIG. 34 



S344 



QUANTIZATION OF 
DCT COEFFICIENTS 


S345 

\ 


r 


INVERTED DC1 
FOR DCT COEf 


r PROCESSING 
r FI CI ENTS 




S342 



DCT PROCESSING 
I 



I -PICTURE 



B- PICTURE 
P- PICTURE 



S351 



ONE-DIMENSIONAL INVERTED 
DCT PROCESSING FOR 
DCT COEFFICIENTS 



S352 



MOTION PREDICTION 



J 



INVERTED DCT PROCESSING 
FOR DCT COEFFICIENTS 



-S348 



SELECTION OF CODING METHOD 



1 



Y 



S349 



VARIABLE LENGTH CODING \^ 



S327 



STRUCTURE CODING FOR 
VARIABLE LENGTH CODES 



-S3 28 



c 



END 



99 



EP 0 862 339 A2 



FIG. 35 



A BLOCK OF DCT 
COEFFICIENTS 



X-DIRECTIONAL INFORMATION 



INVERTED 
DCT 

PROCESSING 



PATTERN 
MATCHING 



. REFERENTIAL 
r> MACRO BLOCK 
^ CONDI DATES 



LUMINANCE SIGNALS OF 
REFERENTIAL FRAME 



PATTERN 
MATCHING 



1> 



i-NMOTION 
H/ VECTOR 



Y-DIRECTIONAL INFORMATION 



INVERTED 
DCT 

PROCESS I NG 



100 



EP 0 862 339 A2 



FIG. 36 



REMARKED CURRENT MACROBLOK 




SPECIFIC REFERENTIAL MACROBLOCK 



REFERENTIAL FRAME 



101 



EP 0 862 339 A2 



FIG. 37 



81 



INPUT UNIT 



Y 



36 



37- 



OUTPUT UN IT| | 



XL 



.82 



38 



PREPARING 
UNIT 



39' 



VARIABLE 
LENGTH 
DECODING 
A UNIT 



INVERTED 

QUANTIZATION 

UNIT 



40 



DCT COEFFICIENT 
CONVERTING UNIT 

±= 



83 



INVERTED 
DCT 

PROCESSING 
UNIT 



41 



.35 



£L 



INPUT 
BUFFER 



S 



43 



CODING 

CONTROL UNIT 



DCT 

COMPRESSING 
UNIT 



-44 



45 



L 



3— 



INVERTED 
DCT 

EXPANDING 
UNIT 



46 



FRAME 
MEMORY 



r 1 



47 



MOTION 

PREDICTING 

UNIT 



42 



CODE V 
SELECTING -i 



r* UNIT 



48 



49 



VARIABLE 
LENGTH 
COD I NG 
UNIT 



XL 



50 



STRUCTURE 

CODING 

UNIT 



102 



EP 0 862 339 A2 



FIG. 38 



FIG. 39 



( START _) 



S401 



DECODING OF COMPRESSED 
PICTURE SIGNALS OF 
DVC FORMAT 




S303 


CODING OF NO 
4:2:0 TYPE C 
PICTURE SIGN 


N-COMPRESSED 

OMPONENT 

ALS 



( END ) 



(" START ) 



S3! 1 



DESHUFFLING 0 
COMPRESSED PI 


' , ... y., . _ 
F DIGITAL 
CTURE SIGNALS 




S312 


VARIABLE LENGTH DECODING 
FOR DIGITAL COMPRESSED 
PICTURE SIGNALS 


* 


S313 


INVERTED QUANTIZATION 
FOR VARIABLE LENGTH 
DECODED INFORMATION 




S41 1 



DCT COEFFICIENT CONVERSION 
OF DCT COEFFICIENTS OF 
4:1:1 TYPE COLOR DIFFERENCE 
SIGNALS TO DCT COEFFICIENTS 
OF 4:2:0 TYPE COLOR 
DIFFERENCE SIGNALS 



S412 



INVERTED DCT PROCESSING 



( ) 



103 



BNSDOCID: <EP 08S2339A2 I > 



EP 0 862 339 A2 



FIG. 40 



A DCT BLOCK OF 4:1:1 TYPE 
COLOR DIFFERENCE SIGNALS 



2 










7^7 




7y 



















































































































DCT COEFFICIENT CONVERSION 




A DCT BLOCK OF 4:2:0 TYPE 
COLOR DIFFERENCE SIGNALS 



INVERTED DCT PROCESSING 




104 



EP 0 862 339 A2 



FIG. 41 



.32 



INPUT UNIT 



.36 



37- 



OUTPUT UNIT 



.^1 



.82 



PREPARING 
UNIT 



38 



77 



39 



VARIABLE 
LENGTH 
DECODING 
UNIT 



INVERTED 

QUANTIZATION 

UNIT 



IT 



40 



DCT COEFFICIENT 
CONVERTING UNIT 



83 



INVERTED 
DCT 

PROCESSING 
UNIT 



DCT 




COEFFICIENT 


BUFFER 





63' 



41 



62 



INPUT 
BUFFER 



43 



CODING 

CONTROL UNIT 



64 



H I ERARCH I CAL 
INVERTED DCT 
PROCESSING 
UNIT 



L+l DCT 

COMPRESSING 
UNIT 



44 



3— 



45 



INVERTED 
DCT 

EXPANDING 
UNIT 



46- 



FRAME 
MEMORY 



65 



MOTION 

PREDICTING 

UNIT 



42 



CODE 



SELECTING -i 



r* UNIT 



48 



49 



VARIABLE 
LENGTH 
CODING 
UNIT 



50 



STRUCTURE 

CODING 

UNIT 



105 



EP 0 862 339 A2 



FIG. 42 



£L 



32 



INPUT UNIT 



,36 



37- 



OUTPUT UNIT I 

A 



.82 



PREPARING 
UNIT 



38 



39 



VARIABLE 
LENGTH 
DECODING 
UNIT 



INVERTED 

QUANTIZATION 

UNIT 



40 



DCT COEFFICIENT 
CONVERTING UNIT 



83 



INVERTED < 
J DCT . 
^ PROCESSING 
UNIT 



DCT 




COEFFICIENT 


BUFFER 





63 



,41 



.72 



INPUT $ 
BUFFER 



43 



CODING 
CONTROL UNIT 



73 



ONE- 
DIMENSIONAL 
INVERTED DCT 
PROCESSING 
UNIT 



DCT 

COMPRESSING 
UNIT 



It 



44 



□ 



45 



1 



INVERTED 
DCT 

EXPANDING 
UNIT 



46- 



FRAME 
MEMORY 



74 



MOTION 

PREDICTING 

UNIT 



s 



42 



CODE 

SELECTING 



r* UNIT 



48 



.49 



VARIABLE 
LENGTH 
CODING 
UNIT 



50 



STRUCTURE 

CODING 

UNIT 



106 



EP 0 862 339 A2 



FIG. 43 

.92 



PICTURE 

REPRODUCING UNIT 






95 



.91 




93 



PICTURE 

INPUTTING UNIT 



.99 



94 

-£L 



.96 



COMMUNICATING 
UNIT 



CONTROL 
UNIT 











STORING UNIT 



97 



PICTURE SIGNAL 
CONVERTING UNIT 



98 



107 



EP 0 862 339 A2 



FIG. 44 A 

( START ) 



S501 



RECEPTION OF PICTURE 
INPUT REQUEST 




S502 


STORAGE OF DIGITAL 
PICTURE SIGNALS 




S503 


CONVERSIO 
COMPRESS 1 


N OF A 
NG FORMAT 



c 



END 



FIG. 44B 

( START ) 



S511 



i CL 

RECEPTION OF PICTURE 
OUTPUT REQUEST 



S512 



OUTPUT OF DIGITAL 
PICTURE SIGNALS 



c 



END 



108 



EP 0 862 339 A2 



FIG. 


45A 




FIG. 


45B 


( START ) 




( START ) 




S521 




S531 


RECEPTION OF PICTURE 
INPUT REQUEST 




RECEPTION OF PICTURE 
OUTPUT REQUEST 




S522 

f 




S532 



STORAGE OF DIGITAL 
PICTURE SIGNALS 



(" END ) 




S533 



CONVERSION OF 
COMPRESSION FORMAT 



S534 



OUTPUT OF DIGITAL 
PICTURE SIGNALS 



( ) 



BNSOOCIO: <EP 0862339A2J_> 



109 



This Page Blank (uspto) 



(ousn) mots 39V.J SIH1 



(19) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(id EP 0 862 339 A3 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

08.03.2000 Bulletin 2000/10 

(43) Date of publication A2: 

02.09.1998 Bulletin 1998/36 

(21) Application number: 98301220.4 

(22) Date of filing: 19.02.1998 



(51) lntci7: H04N 11/20 



(84) Designated Contracting States: 

AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 
NL PT SE 

Designated Extension States: 
AL LT LV MK RO SI 

(30) Priority: 27.02.1997 JP 5860497 
16.06.1997 JP 17274097 

(71) Applicant: Matsushita Electric Industrial Co., Ltd. 
Kadoma-shi, Osaka 571-0050 (JP) 



(72) Inventors: 

• Uenoyama, Tsutomu 
Kawasaki 211 (JP) 

• Komiya, Daisaku 
Tokyo 166 ( J P) 

(74) Representative: Senior, Alan Murray 
J.A. KEMP & CO., 
14 South Square, 
Gray's Inn 

London WC1 R 5LX (GB) 



(54) Method and apparatus for converting color component type of picture signals, method and 
apparatus for converting compression format of picture signals and system for providing 
picture signals of a required compression format 



(57) In this picture signal converting apparatus, dig- 
ital picture signals compressed in a DVC format are de- 
coded to non-compressed picture signals of a 4:1:1 
color component type which are composed of color dif- 
ference signals and luminance signals. The color differ- 
ence signals of the 4:1:1 color component type arranged 
in a matrix are removed on every other row to halve the 
number of color difference signals in a y direction, and 
a color difference signal is added to a position between 
each pair of color difference signals adjacent to each 



other in an x direction to double the number of color dif- 
ference signals in the x direction. Therefore, converted 
color difference signals of a 4:2:0 color component type 
are produced from the color difference signals. Values 
of the converted color difference signals are determined 
according to values of the color difference signals. 
Thereafter, the converted color difference signals and 
the luminance signals of the non-compressed picture 
signals are combined to produce converted digital pic- 
ture signals of the 4:2:0 color component type. 



FIG. 6 



12 



INPUT 
UNIT 



CO 

< 

o> 

CO 
CO 

CM 
CO 
00 

o 

Q. 
LU 



.11 



13 



OUTPUT 
UNIT 



Y FRAME 
MEMORY 



.14 



INPUT Cr 
FRAME MEMORY 



15 



INPUT Cb 
FRAME MEMORY 



.16 



COLOR 

DIFFERENCE 
SIGNAL 
CONVERTING 
UNIT 



17 



OUTPUT Cr 
FRAME II EMORY 



18 



OUTPUT Cb 
FRAME MEMORY 



Priited by Jouve. 75001 PARIS (FR) 



BNSDCClD: <EP_0S62339A3_I_> 



EP 0 862 339 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 98 30 1220 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate. 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (lnt.CI.6) 



EP 0 692 915 A (MATSUSHITA ELECTRIC IND CO 
LTD) 17 January 1996 (1996-01-17) 

* the whole document * 

PATENT ABSTRACTS OF JAPAN 

vol . 1996, no. 06, 

28 June 1996 (1996-06-28) 

& JP 08 037672 A (SONY CORP), 

6 February 1996 (1996-02-06) 

* abstract * 

US 5 412 428 A (TAHARA KATSUM1 ) 
2 May 1995 (1995-05-02) 

* abstract * 

EP 0 554 871 A (SONY CORP) 
11 August 1993 (1993-08-11) 

* page 1, line 1 - page 4, line 35; figure 
14 * 



The present search reoorl has been drawn up for all claims 



1,10-16 

22,28, 

32,36,40 



1,10-16, 

22,28, 

32,36,40 



1,10-16, 

22,28, 

32,36,40 



1,10-16, 

22,28, 

32,36,40 



H04N 11/20 
H04N 11/04 



TECHNICAL FIELDS 
SEARCHED (Int.CU) 



H04N 



Place ot search 

THE HAGUE 



Date of completion ol ihe search 

20 January 2000 



Examiner 

Fuchs, P 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 
- Y : particularly relevant it combined with another 

document ol the same category 
A : technological background 
O ' non-wnttnn disclosure 
P : intermedials document 



T : theory or principle underlying the invention 
E : earter patent document, but published on, or 

after the filing dale 
D : aocument cited in the application 
L : document cited for othar reasons 

& : member of The same patent (amity, corresponding 
document 



BNSDOCID: <EP 0862339A3 I > 



2 



EP 0 862 339 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 98 30 1220 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Oft ice EOP file on 

The European Patent Office is tn no way liable tor these particulars which are merely given for tne purpose ot information. 

20-01-2000 



Patent document 
cited in search report 



Publication 
date 



Patent family 
member(s) 



EP 0692915 



17-01-1996 



JP 
JP 
US 



2933487 B 
3033002 A 
5650824 A 



JP 08037672 A 
US 5412428 A 



06-02-1996 



NONE 



02-05-1995 



JP 
CA 
DE 
OE 
EP 



6205438 
2111021 
69323541 
69323541 
0608618 



EP 0554871 



11-08-1993 



AU 
AU 
CA 
DE 
DE 
JP 
US 



663914 B 
3280793 A 
2088547 A 
69321856 D 
69321856 T 
5284487 A 



5699475 A 



£ 
o 

& For more details about this anne* : see Official Journal ot the European Patent Office, No 1 2/82 



Publication 
date 



16-08-1999 
02-02-1996 
22-07-1997 



22-07-1994 
29-06-1994 
25-03-1999 

02- 09-1999 

03- 08-1994 



26-10-1995 
05-08-1993 
05-08-1993 
10-12-1998 
01-04-1999 
29-10-1993 
16-12-1997 



BNSDOCID: <EP OS62339A3J_> 



3 



This Page Blank (uspto) 



